栏目分类:
子分类:
返回
名师互学网用户登录
快速导航关闭
当前搜索
当前分类
子分类
实用工具
热门搜索
名师互学网 > IT > 面试经验 > 面试问答

如何用keras建立注意力模型?

面试问答 更新时间: 发布时间: IT归档 最新发布 模块sitemap 名妆网 法律咨询 聚返吧 英语巴士网 伯小乐 网商动力

如何用keras建立注意力模型?

初始化

attention layer
和传递参数的方式存在问题。您应该
attention layer
在该位置指定单位数并修改传递参数的方式:

context_vector, attention_weights = Attention(32)(lstm, state_h)

结果:

__________________________________________________________________________________________________Layer (type)         Output Shape         Param #     Connected to          ==================================================================================================input_1 (InputLayer) (None, 200)          0__________________________________________________________________________________________________embedding (Embedding)(None, 200, 128)     32000       input_1[0][0]         __________________________________________________________________________________________________bi_lstm_0 (Bidirectional)       [(None, 200, 256), ( 263168      embedding[0][0]       __________________________________________________________________________________________________bidirectional (Bidirectional)   [(None, 200, 256), ( 394240      bi_lstm_0[0][0]      bi_lstm_0[0][1]      bi_lstm_0[0][2]      bi_lstm_0[0][3]      bi_lstm_0[0][4]       __________________________________________________________________________________________________concatenate (Concatenate)       (None, 256)          0bidirectional[0][1]  bidirectional[0][3]   __________________________________________________________________________________________________attention (Attention)[(None, 256), (None, 16481       bidirectional[0][0]  concatenate[0][0]     __________________________________________________________________________________________________dense_3 (Dense)      (None, 1) 257         attention[0][0]       ==================================================================================================Total params: 706,146Trainable params: 706,146Non-trainable params: 0__________________________________________________________________________________________________None


转载请注明:文章转载自 www.mshxw.com
本文地址:https://www.mshxw.com/it/614273.html
我们一直用心在做
关于我们 文章归档 网站地图 联系我们

版权所有 (c)2021-2022 MSHXW.COM

ICP备案号:晋ICP备2021003244-6号