New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Chapter 1 트랜스포머 입문 #1

Open

emphasis10 opened this issue Jan 3, 2022 · 0 comments

Labels

Member

emphasis10 commented Jan 3, 2022 •

edited

Loading

연습문제

셀프 어텐션의 전체 단계를 설명하라.
스케일 닷 프로덕트 어텐션을 정의하라.
쿼리, 키, 밸류 행렬은 어떻게 생성하는가?
위치 인코딩이 필요한 이유는 무엇인가?
디코더의 서브레이어에는 무엇이 있는가?
디코더의 인코더-디코더 어텐션 레이어의 입력은 무엇인가?

emphasis10 assigned emphasis10 and hee-suh and unassigned emphasis10 and hee-suh

emphasis10 closed this as completed

emphasis10 added the weekly label

emphasis10 reopened this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment