Engineering and Research are for the most part “measurable” in terms of progress. Yet, not everyone has the same amount of success using the same tools. The thing which distinguishes some high performers from the rest is the wizardry that goes into creating the mental frameworks around these tools. It is deeply personal to its creators, yet it offers a great deal to learn from.

Following researchers and engineers write about there systems in a lot of detail. I hate the fact that this is highly concentrated in the domain of CS and Machine Learning. But a large majority of the subsystems apply across domains.

Note : This list is regularly updated with new perspectives and resources from the internet.

Check out their writings here :

• You and Your Research (Richard Hamming) — Classic essay on doing significant research.
• An Opinionated Guide to ML Research (John Schulman) — Practical advice for new researchers.
• Principles of Effective Research (Michael Nielsen) — Timeless principles for research productivity.
• Becoming an Independent Researcher (Andreas Madsen) — The struggles of independent researchers.
• Eugene Yan’s Blog — A treasure trove for meta-research and meta-engineering.
  • Design Docs for ML — How to structure and write effective ML design documents.
  • Design Patterns — Patterns for effective research and engineering.
• Applying ML — Curated resources for production ML and research workflows.
• You Don’t Need Another MOOC (Eugene Yan) — Practical advice on learning and building expertise.
• Kilian Weinberger (YouTube) — How to do Research — Insightful talks on the research process.
• Reproducing Deep RL (Amid Fish) — Lessons from reproducing deep reinforcement learning results.
• ML Productivity (Amid Fish) — Tips and frameworks for productive ML research.
• 10-Point Scale & Wikipedia — Writing Productivity
• Harvard CS197: Communicating Computer Science Research — A comprehensive resource on research communication.
• Your LLM-assisted scientific breakthrough probably isn't real — LessWrong Post