Skip to content
This repository has been archived by the owner on Oct 25, 2024. It is now read-only.

Origin/nightly update rebased #48

Merged
merged 36 commits into from
Mar 6, 2023
Merged

Conversation

VincyZhang
Copy link
Contributor

Type of Change

nightly update

Description

update internal code to external

Expected Behavior & Potential Risk

nightly test

How has this PR been tested?

UT + model test + feature test

Dependency Change?

no

XinyuYe-Intel and others added 30 commits March 3, 2023 10:19
*update translnorm ref impl
update benchmark & fix warning
support s32 input data_type.
calc_mean parallel
modify clac_var
modify test_spmm
modify UT with append sum
modify  wordspace memory as input for multi thread
Replace Intrinsics with JIT code
package spmm+lnorm into layernomalized_spmm ker
make KTile configable.
add the compile for multihead attention
stand-alone trans_mha tmp_buffer for all engine mha-operator
support 2d case & add pseudo code on engine side
fix windows compile fail, runtime-error and remove engine-side dead code.
add 2 seq_cpy jit with dynamic size

* unify bit_cast to avoid compiler error
rename spmm variables for readness
* unify amx configure

---------

Co-authored-by: Hengyu Meng <hengyu.meng@intel.com>
* sync external repo

* update inference readme and main page
* add framework_modeling_config

* add OpAny to save empty op creation effort

* add binary python op registration

* enhance compile and clean codes

* remove Not op in empty_ops

* fix remove node name issue when modify output tensors connections

* add binary_op test
Co-authored-by: VincyZhang <wenxin.zhang@intel.com>
* add squeeze op

* add binary op

* use stride instead of tag

* cast int32 to float32
* modify unsqueeze attr

* modify binary op name
…on (#612)



---------

Co-authored-by: Wang,Zhe <zhe1.wang@intel.com>
Copy link
Contributor

@kevinintel kevinintel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just patch outside

@VincyZhang VincyZhang merged commit c5741bf into main Mar 6, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.