ChatGPT works pretty well for small tasks like the typical homework, even for programming. However if you ask it something slightly more complex it can easily start to invent functions and libraries that don’t exist. Even when it gives you a working solution, most of the time it is not an optimal one or not one that will be written by an expert. It is the equivalent of a mediocre junior programmer that blindly copy pices of code from various places in the hope that it may work.
If it keeps improving, it could replace junior programmers first and later (in a few years) intermediary and expert programmers. At this time, nobody really knows how/if it will improve.