AI-Proof Programming Problem

AI-Proof Programming Problem

For some time I have been trying to come up with some programming problems that can't be solved by ChatGPT and others in the first attempt. I understand that if you repeatedly feed the errors back to the AI chat like ChatGPT (copy/paste) then it does get solved eventually. I tested with ChatGPT and it could not solve in 2 or 3 attempts.

Claude Code solved it in first attempt as it is agetic). The correct answer has 3 tickets which I will share once I have some responses.

Note: The below csv file has few columns extracted from Jira "History" using the Jira API. Sensitive information has been anonymized.

Here is the problem statement:

https://github.com/ansarmuhammad/AI-PROOF-PROGRAMMING-PROBLEM/blob/main/interns-input-file-v5.csv       

The program should read the “interns-input-file-v5.csv” file above (after downloading) and for each ticket it should

1.     Filter tickets where “In Progress” to “Dev Completed”

2.     Do this only for closed tickets

3.     In the “to_value” column, filter for only this value: "Mathew Sinner", this basically the account id of the programmer who we are analyzing

4.     Print the ticket id if all the transitions are not present but at-least the following:

5.     Select tickets that have

5.1.     First filter

5.1.a.     Column "changed_from" = “assignee”

5.1.b.    Column “to_id” = “615af2a3c5388b006968ee2c”

5.2.     Second filter

5.2.a.     “Open” OR “Reopened” in the “from_value” column

5.2.b.    “In Progress” in the “to_value” column

5.3.     Third filter

5.3.a.     “In Progress” in the “from_value” column

5.3.b.    “Dev Completed” in the “to_value” column

6. List tickets that pass this criteria above, you should come up with 3 tickets

Correct answer for the original post is: test1-3426 test1-3464 test1-3466  

Like
Reply

Phase 3 of the test could be to calculate days of effort for each developer in the data set.

Like
Reply

For TEST1-3466, the ticket got reopened once. So first time transitions from "in progress" to "dev completed" were 4 days then reopened to "in progress" to "dev completed" took another 2 days. Total time is 6 days

Like
Reply

For TEST1-3464, the ticket got reopened twice unfortunately. So first time transitions from "in progress" to "dev completed" were 4 days then reopened to "in progress" to "dev completed" took another day. Total time is 5 days

Like
Reply

If we try to calculate effort based on this data then for TEST1-3426, we can consider 1 day effort as the ticket got into "in progress" and "dev completed" on the same day.

Like
Reply

To view or add a comment, sign in

Explore content categories