MyTorch | Not Hacker News!

Discussion (15 comments)

Showing 13 comments of 15

jerkstate

6d ago

4 replies

Karpathy’s micrograd did it first (and better); start here: https://karpathy.ai/zero-to-hero.html

whattheheckheck

6d ago

1 reply

Why is it better

forgotpwd16

6d ago

Cleaner, more straightforward, more compact code, and considered complete in its scope (i.e. implement backpropagation with a PyTorch-y API and train a neural network with it). MyTorch appears to be an author's self-experiment without concrete vision/plan. This is better for author but worse for outsiders/readers.

iguana2000

6d ago

1 reply

Karpathy's material is excellent! This was a project I made for fun, and hopefully provides a different perspective on how this can look

jerkstate

5d ago

1 reply

I'm very sorry, I should have phrased my original post in a kinder, less dismissive way, and kudos to you for not reacting badly to my rudeness. It is a cool repo and a great accomplishment. Implementing autograd is great as a learning exercise, but my opinion is that you're not going to get the performance or functionality of one of the large, mainstream autograd libraries. Karpathy, for example, throws away micrograd after implementing it and uses pytorch in his later exercises. So it's great that you did this, but for others to learn how autograd works, Karpathy is usually a better route, because the concepts are built up one by one and explained thoroughly.

iguana2000

4d ago

No worries, you're good, yes Karpathy is for sure the better route

alkh

6d ago

Imho, we should let people experiment as much as they want. Having more examples is better than less. Still, thanks for the link for the course, this is a top-notch one

richard_chase

6d ago

Harsh.

khushiyant

6d ago

1 reply

Better readme would be way to go

CamperBob2

6d ago

In iguana2000's defense, the code is highly self-documenting.

It arguably reads cleaner than Karpathy's in some respects, as he occasionally gets a little ahead of his students with his '1337 Python skillz.

brandonpelfrey

6d ago

1 reply

Having written a slightly more involved version of this recently myself I think you did a great job of keeping this compact while still readable. This style of library requires some design for sure.

Supporting higher order derivatives was also something I considered, but it’s basically never needed in production models from what I’ve seen.

iguana2000

6d ago

Thanks! I agree about the style

jjzkkj

6d ago

HmcKk

2 more comments available on Hacker News

Resources