Porting Lenet to n300

[saichandax]

• Measure and record current performance.
• Rebase the model to main, ensure the PCC = 0.99
• Port functionality to n300 card (single device) #13405
• Provide Op Report
• Check Model into CI
• Implement Demo
• Implement Data Parallel on n300 #13404

Executive Summary (as of Nov 5):

• Single Device implementation is complete: (BLOCKED) due to pending approvals on #13473

  • PCC = 0.99
  • Torch ops: 2 maxpool (#13624, #12642)
  • BS = 8 (try higher batch size)
  • Perf numbers (with older profiler build):
    • E2E perf is 9.49 samples/sec
    • Device perf is 988.3 samples/sec

• Data parallel implementation is complete: (BLOCKED) due to pending CIs and approvals on #13679

  • PCC = 0.99
  • Along with torch ops as in single device implementation, we have torch reshape and permute to overcome #13860 's low pcc issue
  • BS=16
  • Perf numbers (with old profiler build):
    • E2E perf is 4.47 samples/sec
    • Device perf is 3064.8 samples/sec

• trace_2cqs implementation is not done yet. (BLOCKED due to torch ops in the model)

ToDo:

• Check higher batch size, report new perf numbers and then merge single device implementation once we have approvals.
• Same checks as in single device implementation (bs, perfs) and then merge once we have approvals and passing CIs
• To implement perf with trace_2cqs