Oct 30 22:07:43.852537 ip-10-0-129-150 systemd[1]: Starting Kubernetes Kubelet... Oct 30 22:07:44.263813 ip-10-0-129-150 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 22:07:44.263813 ip-10-0-129-150 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 22:07:44.263813 ip-10-0-129-150 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 22:07:44.263813 ip-10-0-129-150 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 22:07:44.266799 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266734 2564 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:44.266799 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266799 2564 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:44.266799 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266802 2564 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:44.266918 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266808 2564 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:44.266918 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266812 2564 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:44.266918 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266815 2564 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:44.266918 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266818 2564 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:44.266918 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266821 2564 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:44.266918 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266824 2564 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:44.266918 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266827 2564 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:44.266918 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266829 2564 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:44.266918 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266833 2564 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:44.266918 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266837 2564 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:44.266918 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266840 2564 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:44.266918 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266842 2564 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:44.266918 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266845 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:44.266918 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266851 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:44.266918 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266854 2564 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:44.266918 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266857 2564 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:44.266918 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266859 2564 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:44.266918 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266862 2564 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:44.267362 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266864 2564 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:44.267362 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266867 2564 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:44.267362 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266869 2564 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:44.267362 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266872 2564 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:44.267362 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266874 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:44.267362 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266877 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:44.267362 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266879 2564 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:44.267362 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266882 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:44.267362 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266885 2564 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:44.267362 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266887 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:44.267362 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266890 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:44.267362 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266892 2564 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:44.267362 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266895 2564 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:44.267362 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266897 2564 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:44.267362 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266901 2564 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:44.267362 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266904 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:44.267362 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266907 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:44.267362 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266911 2564 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:44.267362 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266913 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:44.267807 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266916 2564 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:44.267807 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266919 2564 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:44.267807 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266921 2564 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:44.267807 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266924 2564 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:44.267807 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266926 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:44.267807 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266929 2564 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:44.267807 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266932 2564 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:44.267807 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266935 2564 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:44.267807 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266938 2564 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:44.267807 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266941 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:44.267807 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266943 2564 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:44.267807 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266946 2564 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:44.267807 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266948 2564 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:44.267807 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266950 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:44.267807 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266954 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:44.267807 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266956 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:44.267807 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266959 2564 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:44.267807 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266962 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:44.267807 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266964 2564 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:44.268267 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266967 2564 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:44.268267 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266969 2564 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:44.268267 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266972 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:44.268267 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266974 2564 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:44.268267 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266977 2564 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:44.268267 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266979 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:44.268267 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266981 2564 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:44.268267 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266984 2564 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:44.268267 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266987 2564 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:44.268267 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266990 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:44.268267 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266993 2564 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:44.268267 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266995 2564 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:44.268267 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.266998 2564 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:44.268267 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267001 2564 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:44.268267 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267003 2564 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:44.268267 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267005 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:44.268267 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267008 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:44.268267 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267010 2564 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:44.268267 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267013 2564 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:44.268267 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267015 2564 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267018 2564 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267020 2564 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267023 2564 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267025 2564 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267028 2564 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267030 2564 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267032 2564 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267035 2564 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267038 2564 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267040 2564 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267043 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267045 2564 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267048 2564 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267050 2564 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267053 2564 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267055 2564 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267058 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267060 2564 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267063 2564 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267065 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:44.268772 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267068 2564 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:44.269299 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267070 2564 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:44.269299 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267072 2564 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:44.269299 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267076 2564 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:44.269299 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267079 2564 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:44.269299 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267081 2564 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:44.269299 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267083 2564 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:44.269299 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267833 2564 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:44.269299 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267840 2564 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:44.269299 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267843 2564 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:44.269299 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267846 2564 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:44.269299 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267848 2564 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:44.269299 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267852 2564 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:44.269299 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267854 2564 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:44.269299 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267863 2564 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:44.269299 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267866 2564 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:44.269299 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267869 2564 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:44.269299 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267871 2564 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:44.269299 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267874 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:44.269299 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267877 2564 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:44.269299 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267880 2564 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:44.269773 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267882 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:44.269773 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267885 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:44.269773 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267888 2564 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:44.269773 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267891 2564 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:44.269773 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267893 2564 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:44.269773 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267896 2564 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:44.269773 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267899 2564 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:44.269773 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267901 2564 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:44.269773 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267904 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:44.269773 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267906 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:44.269773 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267909 2564 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:44.269773 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267911 2564 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:44.269773 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267914 2564 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:44.269773 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267916 2564 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:44.269773 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267918 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:44.269773 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267921 2564 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:44.269773 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267923 2564 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:44.269773 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267926 2564 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:44.269773 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267928 2564 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:44.269773 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267930 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:44.270255 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267933 2564 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:44.270255 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267935 2564 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:44.270255 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267938 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:44.270255 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267940 2564 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:44.270255 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267943 2564 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:44.270255 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267945 2564 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:44.270255 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267948 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:44.270255 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267950 2564 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:44.270255 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267953 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:44.270255 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267955 2564 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:44.270255 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267960 2564 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:44.270255 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267963 2564 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:44.270255 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267965 2564 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:44.270255 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267967 2564 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:44.270255 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267972 2564 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:44.270255 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267976 2564 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:44.270255 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267979 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:44.270255 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267982 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:44.270255 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267984 2564 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:44.270704 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267987 2564 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:44.270704 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267989 2564 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:44.270704 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267992 2564 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:44.270704 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267994 2564 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:44.270704 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267997 2564 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:44.270704 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.267999 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:44.270704 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268002 2564 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:44.270704 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268004 2564 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:44.270704 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268007 2564 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:44.270704 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268009 2564 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:44.270704 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268011 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:44.270704 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268014 2564 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:44.270704 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268016 2564 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:44.270704 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268018 2564 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:44.270704 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268021 2564 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:44.270704 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268023 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:44.270704 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268026 2564 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:44.270704 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268028 2564 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:44.270704 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268031 2564 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:44.270704 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268035 2564 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:44.271210 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268038 2564 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:44.271210 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268040 2564 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:44.271210 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268043 2564 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:44.271210 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268047 2564 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:44.271210 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268050 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:44.271210 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268052 2564 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:44.271210 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268055 2564 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:44.271210 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268057 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:44.271210 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268060 2564 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:44.271210 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268063 2564 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:44.271210 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268065 2564 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:44.271210 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268068 2564 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:44.271210 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268070 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:44.271210 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268073 2564 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:44.271210 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268075 2564 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:44.271210 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268080 2564 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:44.271210 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268083 2564 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:44.271210 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268086 2564 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:44.271210 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268088 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:44.271777 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268091 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:44.271777 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268093 2564 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:44.271777 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268096 2564 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:44.271777 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268098 2564 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:44.271777 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268100 2564 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:44.271777 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268103 2564 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:44.271777 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268105 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:44.271777 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268108 2564 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:44.271777 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268110 2564 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:44.271777 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268113 2564 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:44.271777 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268115 2564 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:44.271777 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268117 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:44.271777 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268121 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:44.271777 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268124 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:44.271777 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268601 2564 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:44.271777 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268607 2564 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:44.271777 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268610 2564 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:44.271777 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268613 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:44.271777 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268615 2564 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:44.272225 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268618 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:44.272225 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268621 2564 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:44.272225 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268623 2564 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:44.272225 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268626 2564 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:44.272225 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268628 2564 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:44.272225 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268631 2564 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:44.272225 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268633 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:44.272225 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268635 2564 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:44.272225 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268638 2564 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:44.272225 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268640 2564 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:44.272225 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268644 2564 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:44.272225 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268646 2564 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:44.272225 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268649 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:44.272225 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268651 2564 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:44.272225 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268654 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:44.272225 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268656 2564 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:44.272225 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268658 2564 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:44.272225 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268661 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:44.272225 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268664 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:44.272689 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268668 2564 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:44.272689 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268671 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:44.272689 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268674 2564 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:44.272689 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268677 2564 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:44.272689 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268680 2564 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:44.272689 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268684 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:44.272689 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268687 2564 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:44.272689 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268690 2564 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:44.272689 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268694 2564 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:44.272689 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268697 2564 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:44.272689 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268699 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:44.272689 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268702 2564 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:44.272689 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268706 2564 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:44.272689 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268710 2564 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:44.272689 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268713 2564 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:44.272689 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268715 2564 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:44.272689 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268718 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:44.272689 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268720 2564 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:44.272689 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268723 2564 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:44.273143 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268725 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:44.273143 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268728 2564 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:44.273143 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268730 2564 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:44.273143 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268733 2564 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:44.273143 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268735 2564 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:44.273143 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268737 2564 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:44.273143 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268740 2564 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:44.273143 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268743 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:44.273143 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268745 2564 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:44.273143 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268748 2564 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:44.273143 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268750 2564 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:44.273143 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268752 2564 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:44.273143 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268755 2564 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:44.273143 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268757 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:44.273143 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268759 2564 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:44.273143 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268762 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:44.273143 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268764 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:44.273143 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268767 2564 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:44.273143 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268770 2564 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:44.273143 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268773 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:44.273639 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268776 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:44.273639 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268778 2564 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:44.273639 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268781 2564 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:44.273639 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268784 2564 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:44.273639 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268787 2564 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:44.273639 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268790 2564 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:44.273639 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268792 2564 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:44.273639 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268794 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:44.273639 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268797 2564 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:44.273639 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268799 2564 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:44.273639 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268802 2564 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:44.273639 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268804 2564 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:44.273639 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268806 2564 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:44.273639 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268809 2564 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:44.273639 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268811 2564 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:44.273639 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268813 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:44.273639 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268816 2564 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:44.273639 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268818 2564 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:44.273639 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268820 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:44.274086 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268823 2564 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:44.274086 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268825 2564 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:44.274086 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268828 2564 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:44.274086 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268830 2564 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:44.274086 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268832 2564 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:44.274086 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268834 2564 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:44.274086 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268837 2564 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:44.274086 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268839 2564 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:44.274086 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268842 2564 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:44.274086 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268844 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:44.274086 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268846 2564 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:44.274086 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268850 2564 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:44.274086 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268852 2564 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:44.274086 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268855 2564 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:44.274086 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268858 2564 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:44.274086 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268861 2564 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:44.274086 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268864 2564 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:44.274086 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268866 2564 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:44.274086 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268869 2564 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:44.274086 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268871 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268874 2564 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268876 2564 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268879 2564 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.268881 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269689 2564 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269699 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269704 2564 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269709 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269713 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269716 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269721 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269725 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269728 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269731 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269734 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269738 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269741 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269744 2564 flags.go:64] FLAG: --cgroup-root="" Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269747 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269750 2564 flags.go:64] FLAG: --client-ca-file="" Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269752 2564 flags.go:64] FLAG: --cloud-provider="external" Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269755 2564 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269759 2564 flags.go:64] FLAG: --cluster-domain="" Oct 30 22:07:44.274586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269767 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269770 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269773 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269776 2564 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269781 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269785 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269788 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269792 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269795 2564 flags.go:64] FLAG: --contention-profiling="false" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269798 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269801 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269804 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269807 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269811 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269814 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269816 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269819 2564 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269822 2564 flags.go:64] FLAG: --enable-server="true" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269825 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269829 2564 flags.go:64] FLAG: --event-burst="100" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269831 2564 flags.go:64] FLAG: --event-qps="50" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269835 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269837 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269840 2564 flags.go:64] FLAG: --eviction-hard="" Oct 30 22:07:44.275132 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269844 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269847 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269850 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269853 2564 flags.go:64] FLAG: --eviction-soft="" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269856 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269859 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269862 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269864 2564 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269868 2564 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269870 2564 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269873 2564 flags.go:64] FLAG: --feature-gates="" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269877 2564 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269882 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269885 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269888 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269891 2564 flags.go:64] FLAG: --healthz-port="10248" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269895 2564 flags.go:64] FLAG: --help="false" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269897 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269900 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269903 2564 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269906 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269909 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269913 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 22:07:44.275770 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269916 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269919 2564 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269921 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269924 2564 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269927 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269930 2564 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269933 2564 flags.go:64] FLAG: --kube-reserved="" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269936 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269939 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269941 2564 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269944 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269947 2564 flags.go:64] FLAG: --lock-file="" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269950 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269953 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269956 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269961 2564 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269964 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269967 2564 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269970 2564 flags.go:64] FLAG: --logging-format="text" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269972 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269975 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269980 2564 flags.go:64] FLAG: --manifest-url="" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269982 2564 flags.go:64] FLAG: --manifest-url-header="" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269987 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269989 2564 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 22:07:44.276345 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269994 2564 flags.go:64] FLAG: --max-pods="110" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.269997 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270000 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270002 2564 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270005 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270008 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270011 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270014 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270020 2564 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270023 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270026 2564 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270029 2564 flags.go:64] FLAG: --pod-cidr="" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270032 2564 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270035 2564 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270037 2564 flags.go:64] FLAG: --pods-per-core="0" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270040 2564 flags.go:64] FLAG: --port="10250" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270043 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270046 2564 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0e5164a540c745e00" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270049 2564 flags.go:64] FLAG: --qos-reserved="" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270052 2564 flags.go:64] FLAG: --read-only-port="10255" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270055 2564 flags.go:64] FLAG: --register-node="true" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270058 2564 flags.go:64] FLAG: --register-with-taints="" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270061 2564 flags.go:64] FLAG: --registry-burst="10" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270064 2564 flags.go:64] FLAG: --registry-qps="5" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270067 2564 flags.go:64] FLAG: --reserved-cpus="" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270070 2564 flags.go:64] FLAG: --reserved-memory="" Oct 30 22:07:44.276937 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270074 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270077 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270081 2564 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270084 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270086 2564 flags.go:64] FLAG: --runonce="false" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270089 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270092 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270095 2564 flags.go:64] FLAG: --seccomp-default="false" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270098 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270101 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270104 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270107 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270110 2564 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270113 2564 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270116 2564 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270118 2564 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270121 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270124 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270127 2564 flags.go:64] FLAG: --system-cgroups="" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270130 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270135 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270137 2564 flags.go:64] FLAG: --tls-cert-file="" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270140 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270144 2564 flags.go:64] FLAG: --tls-min-version="" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270147 2564 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 22:07:44.277556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270150 2564 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270153 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270155 2564 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270158 2564 flags.go:64] FLAG: --v="2" Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270162 2564 flags.go:64] FLAG: --version="false" Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270166 2564 flags.go:64] FLAG: --vmodule="" Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270170 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270173 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270314 2564 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270320 2564 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270322 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270325 2564 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270328 2564 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270330 2564 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270333 2564 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270336 2564 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270339 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270341 2564 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270344 2564 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270346 2564 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270349 2564 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:44.278173 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270352 2564 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:44.278690 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270354 2564 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:44.278690 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270357 2564 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:44.278690 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270359 2564 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:44.278690 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270362 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:44.278690 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270365 2564 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:44.278690 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270368 2564 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:44.278690 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270371 2564 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:44.278690 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270373 2564 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:44.278690 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270378 2564 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:44.278690 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270381 2564 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:44.278690 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270384 2564 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:44.278690 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270387 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:44.278690 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270390 2564 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:44.278690 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270392 2564 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:44.278690 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270395 2564 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:44.278690 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270397 2564 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:44.278690 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270399 2564 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:44.278690 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270402 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:44.278690 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270404 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:44.278690 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270408 2564 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:44.279156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270411 2564 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:44.279156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270413 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:44.279156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270416 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:44.279156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270418 2564 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:44.279156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270420 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:44.279156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270423 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:44.279156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270426 2564 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:44.279156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270428 2564 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:44.279156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270431 2564 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:44.279156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270433 2564 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:44.279156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270435 2564 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:44.279156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270438 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:44.279156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270440 2564 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:44.279156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270443 2564 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:44.279156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270445 2564 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:44.279156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270448 2564 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:44.279156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270450 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:44.279156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270454 2564 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:44.279156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270456 2564 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:44.279612 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270459 2564 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:44.279612 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270461 2564 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:44.279612 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270464 2564 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:44.279612 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270466 2564 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:44.279612 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270468 2564 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:44.279612 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270471 2564 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:44.279612 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270474 2564 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:44.279612 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270476 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:44.279612 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270478 2564 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:44.279612 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270481 2564 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:44.279612 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270484 2564 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:44.279612 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270487 2564 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:44.279612 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270493 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:44.279612 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270496 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:44.279612 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270498 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:44.279612 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270501 2564 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:44.279612 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270503 2564 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:44.279612 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270506 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:44.279612 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270508 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:44.280094 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270511 2564 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:44.280094 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270514 2564 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:44.280094 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270516 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:44.280094 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270518 2564 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:44.280094 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270521 2564 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:44.280094 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270523 2564 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:44.280094 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270526 2564 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:44.280094 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270528 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:44.280094 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270531 2564 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:44.280094 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270534 2564 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:44.280094 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270536 2564 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:44.280094 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270540 2564 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:44.280094 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270542 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:44.280094 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270544 2564 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:44.280094 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270547 2564 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:44.280094 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270550 2564 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:44.280094 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270552 2564 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:44.280094 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270555 2564 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:44.280094 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270557 2564 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:44.280094 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270560 2564 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:44.280675 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270562 2564 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:44.280675 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270564 2564 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:44.280675 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270567 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:44.280675 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270569 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:44.280675 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270572 2564 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:44.280675 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270576 2564 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:44.280675 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270578 2564 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:44.280675 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270581 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:44.280675 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270583 2564 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:44.280675 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270586 2564 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:44.280675 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270588 2564 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:44.280675 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270591 2564 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:44.280675 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270593 2564 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:44.280675 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270595 2564 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:44.280675 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.270621 2564 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 22:07:44.280675 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270655 2564 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:44.281049 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270659 2564 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:44.281049 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270661 2564 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:44.281049 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270664 2564 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:44.281049 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270667 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:44.281049 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270669 2564 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:44.281049 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270672 2564 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:44.281049 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270674 2564 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:44.281049 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270678 2564 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:44.281049 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270681 2564 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:44.281049 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270683 2564 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:44.281049 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270686 2564 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:44.281049 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270688 2564 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:44.281049 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270691 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:44.281049 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270694 2564 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:44.281049 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270696 2564 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:44.281049 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270699 2564 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:44.281049 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270701 2564 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:44.281049 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270705 2564 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:44.281049 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270709 2564 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:44.281513 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270712 2564 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:44.281513 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270715 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:44.281513 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270718 2564 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:44.281513 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270722 2564 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:44.281513 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270724 2564 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:44.281513 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270726 2564 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:44.281513 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270729 2564 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:44.281513 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270731 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:44.281513 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270734 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:44.281513 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270736 2564 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:44.281513 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270739 2564 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:44.281513 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270742 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:44.281513 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270745 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:44.281513 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270747 2564 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:44.281513 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270749 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:44.281513 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270752 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:44.281513 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270754 2564 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:44.281513 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270756 2564 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:44.281513 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270759 2564 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:44.281513 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270761 2564 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:44.281979 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270765 2564 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:44.281979 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270767 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:44.281979 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270770 2564 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:44.281979 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270772 2564 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:44.281979 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270774 2564 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:44.281979 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270778 2564 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:44.281979 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270780 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:44.281979 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270783 2564 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:44.281979 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270785 2564 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:44.281979 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270788 2564 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:44.281979 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270790 2564 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:44.281979 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270792 2564 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:44.281979 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270795 2564 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:44.281979 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270797 2564 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:44.281979 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270800 2564 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:44.281979 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270803 2564 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:44.281979 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270806 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:44.281979 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270808 2564 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:44.281979 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270811 2564 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:44.282431 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270814 2564 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:44.282431 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270817 2564 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:44.282431 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270820 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:44.282431 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270822 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:44.282431 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270825 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:44.282431 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270827 2564 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:44.282431 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270834 2564 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:44.282431 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270836 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:44.282431 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270839 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:44.282431 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270841 2564 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:44.282431 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270844 2564 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:44.282431 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270846 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:44.282431 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270849 2564 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:44.282431 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270852 2564 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:44.282431 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270855 2564 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:44.282431 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270857 2564 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:44.282431 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270860 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:44.282431 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270863 2564 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:44.282431 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270865 2564 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:44.282881 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270867 2564 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:44.282881 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270870 2564 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:44.282881 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270872 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:44.282881 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270875 2564 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:44.282881 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270879 2564 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:44.282881 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270881 2564 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:44.282881 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270884 2564 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:44.282881 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270887 2564 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:44.282881 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270889 2564 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:44.282881 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270892 2564 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:44.282881 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270895 2564 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:44.282881 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270897 2564 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:44.282881 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270900 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:44.282881 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270902 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:44.282881 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270904 2564 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:44.282881 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270907 2564 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:44.282881 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270910 2564 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:44.282881 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270912 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:44.282881 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270914 2564 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:44.282881 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270917 2564 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:44.283398 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270920 2564 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:44.283398 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270923 2564 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:44.283398 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270925 2564 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:44.283398 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270927 2564 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:44.283398 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270930 2564 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:44.283398 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270933 2564 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:44.283398 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270937 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:44.283398 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.270939 2564 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:44.283398 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.276832 2564 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 22:07:44.283398 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.276848 2564 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 22:07:44.283398 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.276858 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 22:07:44.283398 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.276862 2564 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 22:07:44.283398 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276925 2564 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:44.283398 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276931 2564 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:44.283398 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276935 2564 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:44.283398 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276938 2564 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:44.283398 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276941 2564 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:44.283398 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276944 2564 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:44.283398 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276947 2564 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:44.283398 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276950 2564 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:44.283850 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276953 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:44.283850 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276956 2564 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:44.283850 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276958 2564 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:44.283850 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276961 2564 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:44.283850 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276963 2564 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:44.283850 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276966 2564 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:44.283850 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276969 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:44.283850 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276971 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:44.283850 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276974 2564 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:44.283850 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276976 2564 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:44.283850 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276978 2564 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:44.283850 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276981 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:44.283850 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276983 2564 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:44.283850 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276986 2564 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:44.283850 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276988 2564 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:44.283850 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276991 2564 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:44.283850 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276993 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:44.283850 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276996 2564 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:44.283850 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.276998 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:44.284305 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277001 2564 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:44.284305 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277003 2564 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:44.284305 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277007 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:44.284305 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277010 2564 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:44.284305 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277012 2564 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:44.284305 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277015 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:44.284305 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277017 2564 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:44.284305 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277019 2564 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:44.284305 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277022 2564 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:44.284305 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277025 2564 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:44.284305 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277027 2564 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:44.284305 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277030 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:44.284305 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277032 2564 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:44.284305 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277035 2564 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:44.284305 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277037 2564 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:44.284305 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277039 2564 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:44.284305 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277042 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:44.284305 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277044 2564 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:44.284305 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277047 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:44.284305 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277049 2564 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:44.284770 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277052 2564 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:44.284770 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277054 2564 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:44.284770 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277057 2564 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:44.284770 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277059 2564 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:44.284770 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277062 2564 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:44.284770 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277064 2564 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:44.284770 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277067 2564 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:44.284770 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277069 2564 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:44.284770 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277071 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:44.284770 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277074 2564 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:44.284770 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277077 2564 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:44.284770 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277079 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:44.284770 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277082 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:44.284770 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277084 2564 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:44.284770 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277086 2564 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:44.284770 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277090 2564 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:44.284770 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277092 2564 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:44.284770 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277095 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:44.284770 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277097 2564 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:44.284770 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277100 2564 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:44.285252 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277102 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:44.285252 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277104 2564 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:44.285252 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277107 2564 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:44.285252 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277109 2564 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:44.285252 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277112 2564 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:44.285252 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277114 2564 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:44.285252 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277116 2564 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:44.285252 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277119 2564 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:44.285252 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277121 2564 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:44.285252 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277123 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:44.285252 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277127 2564 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:44.285252 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277131 2564 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:44.285252 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277134 2564 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:44.285252 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277137 2564 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:44.285252 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277141 2564 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:44.285252 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277144 2564 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:44.285252 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277148 2564 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:44.285252 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277151 2564 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:44.285252 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277153 2564 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:44.285717 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277156 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:44.285717 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277158 2564 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:44.285717 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277160 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:44.285717 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277163 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:44.285717 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277166 2564 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:44.285717 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277168 2564 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:44.285717 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277171 2564 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:44.285717 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277174 2564 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:44.285717 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277176 2564 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:44.285717 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277179 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:44.285717 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277181 2564 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:44.285717 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277183 2564 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:44.285717 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277186 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:44.285717 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277188 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:44.285717 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277191 2564 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:44.285717 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277193 2564 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:44.285717 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277195 2564 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:44.285717 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277198 2564 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:44.285717 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277200 2564 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:44.286148 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277202 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:44.286148 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.277229 2564 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 22:07:44.286148 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277372 2564 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:44.286148 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277377 2564 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:44.286148 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277380 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:44.286148 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277382 2564 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:44.286148 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277385 2564 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:44.286148 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277387 2564 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:44.286148 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277390 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:44.286148 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277392 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:44.286148 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277395 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:44.286148 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277397 2564 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:44.286148 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277400 2564 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:44.286148 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277402 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:44.286148 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277405 2564 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:44.286148 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277407 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:44.286521 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277410 2564 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:44.286521 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277412 2564 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:44.286521 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277414 2564 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:44.286521 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277417 2564 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:44.286521 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277420 2564 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:44.286521 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277424 2564 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:44.286521 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277426 2564 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:44.286521 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277429 2564 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:44.286521 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277432 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:44.286521 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277434 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:44.286521 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277437 2564 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:44.286521 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277439 2564 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:44.286521 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277442 2564 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:44.286521 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277444 2564 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:44.286521 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277446 2564 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:44.286521 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277449 2564 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:44.286521 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277451 2564 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:44.286521 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277454 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:44.286521 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277456 2564 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:44.286964 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277458 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:44.286964 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277462 2564 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:44.286964 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277465 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:44.286964 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277467 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:44.286964 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277469 2564 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:44.286964 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277472 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:44.286964 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277474 2564 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:44.286964 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277477 2564 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:44.286964 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277479 2564 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:44.286964 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277482 2564 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:44.286964 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277484 2564 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:44.286964 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277487 2564 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:44.286964 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277489 2564 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:44.286964 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277492 2564 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:44.286964 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277494 2564 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:44.286964 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277496 2564 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:44.286964 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277499 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:44.286964 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277501 2564 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:44.286964 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277504 2564 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:44.287419 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277507 2564 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:44.287419 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277509 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:44.287419 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277512 2564 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:44.287419 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277514 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:44.287419 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277517 2564 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:44.287419 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277519 2564 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:44.287419 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277521 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:44.287419 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277524 2564 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:44.287419 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277526 2564 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:44.287419 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277528 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:44.287419 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277531 2564 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:44.287419 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277533 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:44.287419 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277535 2564 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:44.287419 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277538 2564 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:44.287419 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277541 2564 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:44.287419 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277543 2564 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:44.287419 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277546 2564 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:44.287419 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277548 2564 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:44.287419 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277550 2564 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:44.287419 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277553 2564 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:44.287883 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277557 2564 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:44.287883 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277562 2564 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:44.287883 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277566 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:44.287883 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277569 2564 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:44.287883 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277571 2564 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:44.287883 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277574 2564 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:44.287883 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277577 2564 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:44.287883 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277579 2564 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:44.287883 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277582 2564 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:44.287883 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277584 2564 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:44.287883 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277587 2564 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:44.287883 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277589 2564 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:44.287883 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277592 2564 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:44.287883 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277594 2564 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:44.287883 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277597 2564 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:44.287883 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277600 2564 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:44.287883 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277602 2564 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:44.287883 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277605 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:44.287883 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277607 2564 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:44.288417 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277610 2564 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:44.288417 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277612 2564 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:44.288417 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277614 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:44.288417 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277617 2564 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:44.288417 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277619 2564 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:44.288417 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277621 2564 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:44.288417 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277624 2564 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:44.288417 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277627 2564 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:44.288417 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277629 2564 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:44.288417 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277631 2564 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:44.288417 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277634 2564 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:44.288417 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277636 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:44.288417 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277639 2564 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:44.288417 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277641 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:44.288417 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277645 2564 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:44.288766 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.277667 2564 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 22:07:44.288766 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277697 2564 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:44.288766 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277701 2564 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:44.288766 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277704 2564 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:44.288766 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277707 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:44.288766 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277710 2564 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:44.288766 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277713 2564 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:44.288766 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277715 2564 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:44.288766 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277718 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:44.288766 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277720 2564 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:44.288766 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277723 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:44.288766 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277725 2564 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:44.288766 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277728 2564 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:44.288766 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277730 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:44.288766 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277736 2564 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:44.288766 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277739 2564 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:44.289403 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277741 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:44.289403 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277744 2564 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:44.289403 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277746 2564 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:44.289403 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277748 2564 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:44.289403 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277751 2564 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:44.289403 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277753 2564 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:44.289403 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277756 2564 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:44.289403 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277758 2564 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:44.289403 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277761 2564 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:44.289403 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277763 2564 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:44.289403 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277766 2564 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:44.289403 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277770 2564 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:44.289403 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277773 2564 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:44.289403 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277776 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:44.289403 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277779 2564 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:44.289403 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277783 2564 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:44.289403 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277786 2564 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:44.289403 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277788 2564 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:44.289403 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277791 2564 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:44.290092 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277794 2564 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:44.290092 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277796 2564 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:44.290092 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277799 2564 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:44.290092 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277801 2564 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:44.290092 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277804 2564 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:44.290092 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277806 2564 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:44.290092 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277808 2564 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:44.290092 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277810 2564 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:44.290092 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277813 2564 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:44.290092 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277815 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:44.290092 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277818 2564 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:44.290092 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277820 2564 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:44.290092 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277824 2564 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:44.290092 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277826 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:44.290092 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277829 2564 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:44.290092 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277831 2564 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:44.290092 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277833 2564 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:44.290092 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277836 2564 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:44.290092 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277838 2564 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:44.290092 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277841 2564 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:44.290680 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277843 2564 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:44.290680 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277846 2564 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:44.290680 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277848 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:44.290680 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277851 2564 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:44.290680 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277853 2564 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:44.290680 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277856 2564 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:44.290680 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277858 2564 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:44.290680 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277861 2564 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:44.290680 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277864 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:44.290680 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277867 2564 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:44.290680 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277869 2564 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:44.290680 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277872 2564 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:44.290680 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277874 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:44.290680 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277876 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:44.290680 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277879 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:44.290680 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277881 2564 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:44.290680 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277883 2564 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:44.290680 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277886 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:44.290680 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277888 2564 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:44.291156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277891 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:44.291156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277894 2564 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:44.291156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277896 2564 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:44.291156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277898 2564 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:44.291156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277901 2564 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:44.291156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277904 2564 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:44.291156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277908 2564 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:44.291156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277911 2564 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:44.291156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277914 2564 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:44.291156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277917 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:44.291156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277920 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:44.291156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277923 2564 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:44.291156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277926 2564 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:44.291156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277931 2564 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:44.291156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277935 2564 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:44.291156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277939 2564 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:44.291156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277942 2564 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:44.291156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277944 2564 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:44.291156 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277947 2564 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:44.291679 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277949 2564 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:44.291679 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277952 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:44.291679 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277956 2564 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:44.291679 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277960 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:44.291679 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277962 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:44.291679 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277965 2564 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:44.291679 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277967 2564 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:44.291679 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277969 2564 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:44.291679 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277972 2564 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:44.291679 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277974 2564 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:44.291679 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277976 2564 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:44.291679 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277979 2564 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:44.291679 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277981 2564 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:44.291679 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:44.277983 2564 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:44.291679 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.278035 2564 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 22:07:44.291679 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.280420 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 30 22:07:44.291679 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.281112 2564 server.go:1014] "Starting client certificate rotation" Oct 30 22:07:44.291679 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.281203 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 22:07:44.292126 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.281249 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 22:07:44.292126 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.284251 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 22:07:44.293461 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.293436 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 22:07:44.301820 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.301802 2564 log.go:25] "Validated CRI v1 runtime API" Oct 30 22:07:44.304476 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.304453 2564 log.go:25] "Validated CRI v1 image API" Oct 30 22:07:44.305895 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.305872 2564 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 22:07:44.309033 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.309016 2564 fs.go:135] Filesystem UUIDs: map[55071cbe-ead8-4be4-9d71-6c7fdfbb7dfd:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 bbdf3398-c4c6-4c02-acb6-9a1e1317dc2a:/dev/nvme0n1p4] Oct 30 22:07:44.309085 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.309033 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 30 22:07:44.313601 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.313497 2564 manager.go:217] Machine: {Timestamp:2026-10-30 22:07:44.313021527 +0000 UTC m=+0.341731445 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095097 MemoryCapacity:32812007424 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec256b0e820bc613be9a99c1edcd8b22 SystemUUID:ec256b0e-820b-c613-be9a-99c1edcd8b22 BootID:33cc6562-ad9c-4235-b726-13a9f92d9252 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406003712 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562402304 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406003712 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0a:42:92:05:5b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0a:42:92:05:5b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:f9:24:35:20:39 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812007424 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 22:07:44.313980 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.313970 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 22:07:44.314053 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.314041 2564 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 22:07:44.316511 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.316487 2564 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 22:07:44.316628 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.316514 2564 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-150.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 22:07:44.317121 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.317111 2564 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 22:07:44.317151 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.317123 2564 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 22:07:44.317151 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.317136 2564 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 22:07:44.317925 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.317916 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 22:07:44.318641 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.318631 2564 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 22:07:44.322316 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.322304 2564 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 22:07:44.322423 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.322414 2564 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 22:07:44.323483 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.323474 2564 kubelet.go:493] "Attempting to sync node with API server" Oct 30 22:07:44.323519 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.323486 2564 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 22:07:44.323519 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.323496 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 22:07:44.323519 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.323504 2564 kubelet.go:405] "Adding apiserver pod source" Oct 30 22:07:44.323519 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.323512 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 22:07:44.323832 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.323820 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 22:07:44.325735 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.325719 2564 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 22:07:44.330220 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.330208 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 22:07:44.330818 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.330806 2564 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 22:07:44.330848 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.330837 2564 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 22:07:44.330990 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.330980 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 22:07:44.331017 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.330997 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 22:07:44.331017 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.331003 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 22:07:44.331017 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.331009 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 22:07:44.331017 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.331014 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 22:07:44.331115 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.331020 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 22:07:44.335016 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.335007 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 22:07:44.335052 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.335017 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 22:07:44.335052 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.335024 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 22:07:44.335052 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.335030 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 22:07:44.335052 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.335039 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 22:07:44.335052 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.335049 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 22:07:44.336094 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.336083 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 22:07:44.336128 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.336100 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 22:07:44.340416 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.340404 2564 server.go:1263] "Started kubelet" Oct 30 22:07:44.340587 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.340537 2564 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 22:07:44.340587 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.340551 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 22:07:44.340694 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.340615 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 22:07:44.341055 ip-10-0-129-150 systemd[1]: Started Kubernetes Kubelet. Oct 30 22:07:44.341786 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.341721 2564 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 22:07:44.344144 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.344122 2564 server.go:317] "Adding debug handlers to kubelet server" Oct 30 22:07:44.346223 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:44.346204 2564 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 30 22:07:44.347127 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.347114 2564 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 22:07:44.347190 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.347136 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 22:07:44.347274 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:44.347228 2564 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-129-150.us-west-1.compute.internal\" not found" Oct 30 22:07:44.347611 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.347593 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 22:07:44.347698 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.347608 2564 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 22:07:44.347698 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.347626 2564 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 22:07:44.347789 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.347737 2564 reconstruct.go:97] "Volume reconstruction finished" Oct 30 22:07:44.347789 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.347745 2564 reconciler.go:29] "Reconciler: start to sync state" Oct 30 22:07:44.348410 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.348395 2564 factory.go:153] Registering CRI-O factory Oct 30 22:07:44.348410 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.348410 2564 factory.go:223] Registration of the crio container factory successfully Oct 30 22:07:44.348548 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.348465 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 22:07:44.348548 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.348472 2564 factory.go:55] Registering systemd factory Oct 30 22:07:44.348548 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.348478 2564 factory.go:223] Registration of the systemd container factory successfully Oct 30 22:07:44.348548 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.348488 2564 factory.go:103] Registering Raw factory Oct 30 22:07:44.348548 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.348499 2564 manager.go:1199] Started watching for new ooms in manager Oct 30 22:07:44.350092 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.350077 2564 manager.go:319] Starting recovery of all containers Oct 30 22:07:44.360374 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.360354 2564 manager.go:324] Recovery completed Oct 30 22:07:44.364252 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.364221 2564 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:44.365623 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.365601 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientMemory" Oct 30 22:07:44.365690 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.365634 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:44.365690 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.365646 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientPID" Oct 30 22:07:44.366130 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.366118 2564 cpu_manager.go:226] "Starting" policy="none" Oct 30 22:07:44.366180 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.366129 2564 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 22:07:44.366180 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.366149 2564 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 22:07:44.366294 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.366131 2564 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:44.367411 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.367312 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientMemory" Oct 30 22:07:44.367411 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.367342 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:44.367411 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.367358 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientPID" Oct 30 22:07:44.368456 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.368441 2564 policy_none.go:50] "Start" Oct 30 22:07:44.368504 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.368464 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 22:07:44.368504 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.368478 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 22:07:44.370600 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.370589 2564 policy_none.go:44] "Start" Oct 30 22:07:44.429897 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.411893 2564 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 22:07:44.429897 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.414281 2564 manager.go:341] "Starting Device Plugin manager" Oct 30 22:07:44.429897 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:44.414717 2564 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 22:07:44.429897 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.414731 2564 server.go:87] "Starting device plugin registration server" Oct 30 22:07:44.429897 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.414930 2564 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 22:07:44.429897 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.414938 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 22:07:44.429897 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.415131 2564 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 22:07:44.429897 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.415211 2564 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 22:07:44.429897 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.415219 2564 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 22:07:44.429897 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:44.415679 2564 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 22:07:44.429897 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:44.415715 2564 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-150.us-west-1.compute.internal\" not found" Oct 30 22:07:44.429897 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.424191 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 22:07:44.429897 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.425444 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 22:07:44.429897 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.425465 2564 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 22:07:44.429897 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.425482 2564 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 22:07:44.429897 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:44.425512 2564 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Oct 30 22:07:44.484876 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.484857 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-150.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 30 22:07:44.484876 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:44.484855 2564 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-150.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 30 22:07:44.515637 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.515480 2564 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:44.516346 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.516326 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientMemory" Oct 30 22:07:44.516410 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.516361 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:44.516410 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.516371 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientPID" Oct 30 22:07:44.516410 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.516397 2564 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.526390 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.526359 2564 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal"] Oct 30 22:07:44.526439 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.526419 2564 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:44.527085 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.527070 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientMemory" Oct 30 22:07:44.527140 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.527103 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:44.527140 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.527119 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientPID" Oct 30 22:07:44.529495 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.529483 2564 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:44.529665 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.529650 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.529726 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.529687 2564 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:44.530192 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.530177 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientMemory" Oct 30 22:07:44.530192 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.530187 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientMemory" Oct 30 22:07:44.530308 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.530206 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:44.530308 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.530209 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:44.530308 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.530217 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientPID" Oct 30 22:07:44.530308 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.530220 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientPID" Oct 30 22:07:44.532332 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.532312 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.532332 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.532334 2564 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:44.532965 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.532940 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientMemory" Oct 30 22:07:44.533025 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.532975 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:44.533025 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.532984 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientPID" Oct 30 22:07:44.534980 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:44.534062 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-150.us-west-1.compute.internal.18e36e09a5e17426 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-150.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-150.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 22:07:44.340366374 +0000 UTC m=+0.369076293,LastTimestamp:2026-10-30 22:07:44.340366374 +0000 UTC m=+0.369076293,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-150.us-west-1.compute.internal,}" Oct 30 22:07:44.549045 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.549029 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a0c404c8d77f01c057faf5619397a983-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal\" (UID: \"a0c404c8d77f01c057faf5619397a983\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.549127 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.549058 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0c404c8d77f01c057faf5619397a983-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal\" (UID: \"a0c404c8d77f01c057faf5619397a983\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.549166 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.549152 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b1d3741bfbe7d5cade012c8699af4bf8-config\") pod \"kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal\" (UID: \"b1d3741bfbe7d5cade012c8699af4bf8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.568670 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:44.568649 2564 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-150.us-west-1.compute.internal\" not found" node="ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.570994 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:44.570977 2564 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-150.us-west-1.compute.internal\" not found" node="ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.593035 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:44.593008 2564 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Oct 30 22:07:44.593035 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:44.592967 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-150.us-west-1.compute.internal.18e36e09a762ce82 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-150.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-150.us-west-1.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-150.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 22:07:44.365620866 +0000 UTC m=+0.394330786,LastTimestamp:2026-10-30 22:07:44.365620866 +0000 UTC m=+0.394330786,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-150.us-west-1.compute.internal,}" Oct 30 22:07:44.593164 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:44.593052 2564 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Oct 30 22:07:44.593164 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:44.593053 2564 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-150.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Oct 30 22:07:44.593350 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:44.593331 2564 reflector.go:204] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" Oct 30 22:07:44.617817 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.617797 2564 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 22:07:44.617892 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.617848 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pmc9j" Oct 30 22:07:44.648845 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:44.648819 2564 kubelet_node_status.go:115] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-129-150.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.648921 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:44.648805 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-150.us-west-1.compute.internal.18e36e09a7631822 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-150.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-150.us-west-1.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-150.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 22:07:44.365639714 +0000 UTC m=+0.394349631,LastTimestamp:2026-10-30 22:07:44.365639714 +0000 UTC m=+0.394349631,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-150.us-west-1.compute.internal,}" Oct 30 22:07:44.649284 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.649266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a0c404c8d77f01c057faf5619397a983-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal\" (UID: \"a0c404c8d77f01c057faf5619397a983\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.649338 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.649304 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0c404c8d77f01c057faf5619397a983-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal\" (UID: \"a0c404c8d77f01c057faf5619397a983\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.649385 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.649370 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0c404c8d77f01c057faf5619397a983-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal\" (UID: \"a0c404c8d77f01c057faf5619397a983\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.649385 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.649387 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b1d3741bfbe7d5cade012c8699af4bf8-config\") pod \"kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal\" (UID: \"b1d3741bfbe7d5cade012c8699af4bf8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.649466 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.649371 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a0c404c8d77f01c057faf5619397a983-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal\" (UID: \"a0c404c8d77f01c057faf5619397a983\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.649466 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.649414 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b1d3741bfbe7d5cade012c8699af4bf8-config\") pod \"kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal\" (UID: \"b1d3741bfbe7d5cade012c8699af4bf8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.811326 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:44.811282 2564 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-150.us-west-1.compute.internal\" not found" node="ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.849169 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.849152 2564 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:44.849972 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.849955 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientMemory" Oct 30 22:07:44.850059 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.849989 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:44.850059 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.850006 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientPID" Oct 30 22:07:44.850059 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.850039 2564 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.870722 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.870704 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.875340 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.875140 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.907634 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:44.907616 2564 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:44.907634 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:44.907634 2564 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-150.us-west-1.compute.internal\": node \"ip-10-0-129-150.us-west-1.compute.internal\" not found" Oct 30 22:07:45.023569 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:45.023547 2564 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-129-150.us-west-1.compute.internal\" not found" Oct 30 22:07:45.124674 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:45.124631 2564 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-129-150.us-west-1.compute.internal\" not found" Oct 30 22:07:45.224866 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:45.224847 2564 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-129-150.us-west-1.compute.internal\" not found" Oct 30 22:07:45.281367 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:45.281349 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 30 22:07:45.281817 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:45.281511 2564 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a6f4d41d4389f4fb28595b18760ef362-f326b7236f2e3088.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-129-150.us-west-1.compute.internal.18e36e09a7633e32\": read tcp 10.0.129.150:53342->3.130.97.254:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-129-150.us-west-1.compute.internal.18e36e09a7633e32 default 4937 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-150.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-150.us-west-1.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-150.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 22:07:44 +0000 UTC,LastTimestamp:2026-10-30 22:07:44.516375084 +0000 UTC m=+0.545085002,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-150.us-west-1.compute.internal,}" Oct 30 22:07:45.325748 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:45.325728 2564 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-129-150.us-west-1.compute.internal\" not found" Oct 30 22:07:45.426396 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:45.426342 2564 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-129-150.us-west-1.compute.internal\" not found" Oct 30 22:07:45.527356 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:45.527336 2564 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-129-150.us-west-1.compute.internal\" not found" Oct 30 22:07:45.552379 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:45.552352 2564 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:45.553785 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:45.553763 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientMemory" Oct 30 22:07:45.553879 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:45.553799 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:45.553879 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:45.553811 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientPID" Oct 30 22:07:45.622458 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:45.622427 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 22:02:45 +0000 UTC" deadline="2028-08-08 13:39:20.465238504 +0000 UTC" Oct 30 22:07:45.622458 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:45.622453 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15543h31m34.842788261s" Oct 30 22:07:45.627588 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:45.627560 2564 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-129-150.us-west-1.compute.internal\" not found" Oct 30 22:07:45.727162 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:45.727104 2564 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:45.748089 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:45.748060 2564 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:45.772579 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:45.772559 2564 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:45.809685 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:45.809665 2564 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 22:07:45.811107 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:45.811092 2564 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:07:45.881553 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:45.881533 2564 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 22:07:45.894949 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:45.894930 2564 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:46.019683 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:46.019652 2564 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1d3741bfbe7d5cade012c8699af4bf8.slice/crio-2ba61a5f56077b56e059ca8a9d0da750142b5b5e02b3217f0bfe06c9f16ad059 WatchSource:0}: Error finding container 2ba61a5f56077b56e059ca8a9d0da750142b5b5e02b3217f0bfe06c9f16ad059: Status 404 returned error can't find the container with id 2ba61a5f56077b56e059ca8a9d0da750142b5b5e02b3217f0bfe06c9f16ad059 Oct 30 22:07:46.020117 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:46.020091 2564 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0c404c8d77f01c057faf5619397a983.slice/crio-88bd07b7953c3534d7040d3f704dc5f6e16fb63e7890cb224371eabb16a6c229 WatchSource:0}: Error finding container 88bd07b7953c3534d7040d3f704dc5f6e16fb63e7890cb224371eabb16a6c229: Status 404 returned error can't find the container with id 88bd07b7953c3534d7040d3f704dc5f6e16fb63e7890cb224371eabb16a6c229 Oct 30 22:07:46.024065 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.024045 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:07:46.125371 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.125353 2564 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:46.326181 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.326155 2564 apiserver.go:52] "Watching apiserver" Oct 30 22:07:46.348297 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.348271 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 30 22:07:46.434181 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.434121 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal" event={"ID":"b1d3741bfbe7d5cade012c8699af4bf8","Type":"ContainerStarted","Data":"2ba61a5f56077b56e059ca8a9d0da750142b5b5e02b3217f0bfe06c9f16ad059"} Oct 30 22:07:46.435180 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.435157 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" event={"ID":"a0c404c8d77f01c057faf5619397a983","Type":"ContainerStarted","Data":"88bd07b7953c3534d7040d3f704dc5f6e16fb63e7890cb224371eabb16a6c229"} Oct 30 22:07:46.441421 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.440224 2564 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 22:07:46.441421 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.441230 2564 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-cqphm","openshift-dns/node-resolver-pr5jx","openshift-multus/multus-additional-cni-plugins-xmvbh","kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp","openshift-image-registry/node-ca-rfh52","openshift-ovn-kubernetes/ovnkube-node-xwncm","openshift-cluster-node-tuning-operator/tuned-69mlp","openshift-multus/multus-gwx2d","openshift-multus/network-metrics-daemon-thzg4","openshift-network-operator/iptables-alerter-h5z4s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal","openshift-network-diagnostics/network-check-target-chglk","kube-system/global-pull-secret-syncer-ztkhr"] Oct 30 22:07:46.445789 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.445772 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:07:46.445879 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:46.445855 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thzg4" podUID="14afa5d3-bd87-4cb2-9c75-9059d4072250" Oct 30 22:07:46.447993 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.447975 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:07:46.448073 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:46.448052 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chglk" podUID="aec2e919-1d2a-4605-ba3b-d6f973ef036a" Oct 30 22:07:46.450163 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.450149 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.452330 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.452306 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:07:46.452424 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:46.452379 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztkhr" podUID="1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be" Oct 30 22:07:46.454563 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.454544 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.456880 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.456858 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rfh52" Oct 30 22:07:46.459344 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.459300 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.459344 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.459337 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01279335-4077-4099-85cb-ec0ed9925c7b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.459496 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.459404 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01279335-4077-4099-85cb-ec0ed9925c7b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.459496 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.459431 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs\") pod \"network-metrics-daemon-thzg4\" (UID: \"14afa5d3-bd87-4cb2-9c75-9059d4072250\") " pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:07:46.459496 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.459460 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrbdv\" (UniqueName: \"kubernetes.io/projected/14afa5d3-bd87-4cb2-9c75-9059d4072250-kube-api-access-qrbdv\") pod \"network-metrics-daemon-thzg4\" (UID: \"14afa5d3-bd87-4cb2-9c75-9059d4072250\") " pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:07:46.459640 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.459518 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01279335-4077-4099-85cb-ec0ed9925c7b-system-cni-dir\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.459640 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.459558 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01279335-4077-4099-85cb-ec0ed9925c7b-cni-binary-copy\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.459640 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.459606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7cws\" (UniqueName: \"kubernetes.io/projected/01279335-4077-4099-85cb-ec0ed9925c7b-kube-api-access-g7cws\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.459743 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.459649 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8fmp\" (UniqueName: \"kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp\") pod \"network-check-target-chglk\" (UID: \"aec2e919-1d2a-4605-ba3b-d6f973ef036a\") " pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:07:46.459743 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.459670 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01279335-4077-4099-85cb-ec0ed9925c7b-cnibin\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.459743 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.459707 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01279335-4077-4099-85cb-ec0ed9925c7b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.462509 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.462491 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.464947 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.464927 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pr5jx" Oct 30 22:07:46.467349 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.467329 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cqphm" Oct 30 22:07:46.469553 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.469529 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h5z4s" Oct 30 22:07:46.471981 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.471964 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.508121 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.508100 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 22:07:46.508207 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.508100 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 22:07:46.508253 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.508205 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 22:07:46.508656 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.508641 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 22:07:46.508964 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.508948 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 22:07:46.509009 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.508991 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-78xqf\"" Oct 30 22:07:46.510733 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.510716 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 22:07:46.511289 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.511277 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 22:07:46.511365 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.511355 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 22:07:46.511432 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.511419 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2wgjn\"" Oct 30 22:07:46.513088 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.513073 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lmcdt\"" Oct 30 22:07:46.513505 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.513483 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 22:07:46.515627 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.515609 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 22:07:46.515707 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.515695 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 22:07:46.516161 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.516145 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 22:07:46.518136 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.518123 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-mmvq7\"" Oct 30 22:07:46.518630 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.518616 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 22:07:46.521862 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.521848 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 22:07:46.522031 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.522016 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 22:07:46.522087 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.522074 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 22:07:46.522121 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.522107 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lds9w\"" Oct 30 22:07:46.522156 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.522148 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 22:07:46.522606 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.522592 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 22:07:46.523327 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.523313 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dl5xt\"" Oct 30 22:07:46.549305 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.549261 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 22:07:46.550605 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.550592 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 22:07:46.550654 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.550607 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 22:07:46.560469 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560442 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-cnibin\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.560516 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560474 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01279335-4077-4099-85cb-ec0ed9925c7b-cni-binary-copy\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.560516 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560493 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.560516 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560508 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-etc-openvswitch\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.560628 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560525 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-run-ovn\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.560628 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560566 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-run-ovn-kubernetes\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.560628 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560611 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-sysctl-d\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.560739 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560640 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-systemd\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.560739 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560678 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01279335-4077-4099-85cb-ec0ed9925c7b-cnibin\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.560739 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560699 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-socket-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.560839 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560749 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-kubelet-config\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:07:46.560839 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560765 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01279335-4077-4099-85cb-ec0ed9925c7b-cnibin\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.560839 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02b6cf19-863a-4c44-89e9-ccfd393bbf59-serviceca\") pod \"node-ca-rfh52\" (UID: \"02b6cf19-863a-4c44-89e9-ccfd393bbf59\") " pod="openshift-image-registry/node-ca-rfh52" Oct 30 22:07:46.560839 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560820 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qhkv\" (UniqueName: \"kubernetes.io/projected/02b6cf19-863a-4c44-89e9-ccfd393bbf59-kube-api-access-8qhkv\") pod \"node-ca-rfh52\" (UID: \"02b6cf19-863a-4c44-89e9-ccfd393bbf59\") " pod="openshift-image-registry/node-ca-rfh52" Oct 30 22:07:46.560970 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560857 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-var-lib-cni-bin\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.560970 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.560970 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560902 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01279335-4077-4099-85cb-ec0ed9925c7b-cni-binary-copy\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.560970 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560915 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9cc4dd2-875f-412d-bf36-880c5f383193-ovnkube-config\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.560970 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560938 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-run\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.561135 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560968 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5a0a698f-3051-4639-90c8-e4385348feea-etc-tuned\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.561135 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.560991 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-run-k8s-cni-cncf-io\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.561135 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561019 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-var-lib-cni-multus\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.561135 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561035 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-slash\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.561135 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561091 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9cc4dd2-875f-412d-bf36-880c5f383193-env-overrides\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.561135 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561114 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85-tmp-dir\") pod \"node-resolver-pr5jx\" (UID: \"fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85\") " pod="openshift-dns/node-resolver-pr5jx" Oct 30 22:07:46.561362 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561138 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs\") pod \"network-metrics-daemon-thzg4\" (UID: \"14afa5d3-bd87-4cb2-9c75-9059d4072250\") " pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:07:46.561362 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561159 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-var-lib-openvswitch\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.561362 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561175 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-cni-bin\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.561362 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561190 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-system-cni-dir\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.561362 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:46.561201 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:46.561362 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561205 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-multus-socket-dir-parent\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.561362 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561220 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwpl5\" (UniqueName: \"kubernetes.io/projected/5a0a698f-3051-4639-90c8-e4385348feea-kube-api-access-kwpl5\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.561362 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:46.561269 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs podName:14afa5d3-bd87-4cb2-9c75-9059d4072250 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:47.061236753 +0000 UTC m=+3.089946672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs") pod "network-metrics-daemon-thzg4" (UID: "14afa5d3-bd87-4cb2-9c75-9059d4072250") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:46.561362 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561283 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7cws\" (UniqueName: \"kubernetes.io/projected/01279335-4077-4099-85cb-ec0ed9925c7b-kube-api-access-g7cws\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.561362 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561303 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-registration-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.561362 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561347 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lv7v\" (UniqueName: \"kubernetes.io/projected/d8a728f8-1427-4a89-8102-6580684a157d-kube-api-access-6lv7v\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.561743 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-run-openvswitch\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.561743 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561399 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-sysctl-conf\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.561743 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561416 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9cc4dd2-875f-412d-bf36-880c5f383193-ovnkube-script-lib\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.561743 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561440 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrbdv\" (UniqueName: \"kubernetes.io/projected/14afa5d3-bd87-4cb2-9c75-9059d4072250-kube-api-access-qrbdv\") pod \"network-metrics-daemon-thzg4\" (UID: \"14afa5d3-bd87-4cb2-9c75-9059d4072250\") " pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:07:46.561743 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561457 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrm8z\" (UniqueName: \"kubernetes.io/projected/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-kube-api-access-zrm8z\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.561743 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561552 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02b6cf19-863a-4c44-89e9-ccfd393bbf59-host\") pod \"node-ca-rfh52\" (UID: \"02b6cf19-863a-4c44-89e9-ccfd393bbf59\") " pod="openshift-image-registry/node-ca-rfh52" Oct 30 22:07:46.561743 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561586 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-dbus\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:07:46.561743 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561607 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85-hosts-file\") pod \"node-resolver-pr5jx\" (UID: \"fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85\") " pod="openshift-dns/node-resolver-pr5jx" Oct 30 22:07:46.561743 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561629 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-host\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.561743 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561653 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01279335-4077-4099-85cb-ec0ed9925c7b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.561743 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561685 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-hostroot\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.561743 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561715 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lbss\" (UniqueName: \"kubernetes.io/projected/a9cc4dd2-875f-412d-bf36-880c5f383193-kube-api-access-8lbss\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.561743 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561740 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb1d231f-4920-49d0-bd0c-4a23690b2956-iptables-alerter-script\") pod \"iptables-alerter-h5z4s\" (UID: \"bb1d231f-4920-49d0-bd0c-4a23690b2956\") " pod="openshift-network-operator/iptables-alerter-h5z4s" Oct 30 22:07:46.562175 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561767 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8a728f8-1427-4a89-8102-6580684a157d-cni-binary-copy\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.562175 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561790 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-run-systemd\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.562175 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561815 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-cni-netd\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.562175 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561857 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-sysconfig\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.562175 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561893 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-sys\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.562175 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561935 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-lib-modules\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.562175 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.561998 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-var-lib-kubelet\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.562175 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562030 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-device-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.562175 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562054 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-multus-cni-dir\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.562175 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562079 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:07:46.562175 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562106 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f20cb0c1-6f52-41e1-978d-f59baf6bab48-agent-certs\") pod \"konnectivity-agent-cqphm\" (UID: \"f20cb0c1-6f52-41e1-978d-f59baf6bab48\") " pod="kube-system/konnectivity-agent-cqphm" Oct 30 22:07:46.562175 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562135 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46xsc\" (UniqueName: \"kubernetes.io/projected/bb1d231f-4920-49d0-bd0c-4a23690b2956-kube-api-access-46xsc\") pod \"iptables-alerter-h5z4s\" (UID: \"bb1d231f-4920-49d0-bd0c-4a23690b2956\") " pod="openshift-network-operator/iptables-alerter-h5z4s" Oct 30 22:07:46.562175 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562141 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01279335-4077-4099-85cb-ec0ed9925c7b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.562175 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562165 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01279335-4077-4099-85cb-ec0ed9925c7b-system-cni-dir\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.562731 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562188 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-run-netns\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.562731 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562193 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01279335-4077-4099-85cb-ec0ed9925c7b-system-cni-dir\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.562731 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562235 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-var-lib-kubelet\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.562731 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562273 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-run-multus-certs\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.562731 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562302 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-systemd-units\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.562731 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-log-socket\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.562731 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562352 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdb9n\" (UniqueName: \"kubernetes.io/projected/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85-kube-api-access-rdb9n\") pod \"node-resolver-pr5jx\" (UID: \"fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85\") " pod="openshift-dns/node-resolver-pr5jx" Oct 30 22:07:46.562731 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562374 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-kubernetes\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.562731 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01279335-4077-4099-85cb-ec0ed9925c7b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.562731 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562410 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01279335-4077-4099-85cb-ec0ed9925c7b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.562731 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562426 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.562731 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562440 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-run-netns\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.562731 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562455 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-node-log\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.562731 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562474 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f20cb0c1-6f52-41e1-978d-f59baf6bab48-konnectivity-ca\") pod \"konnectivity-agent-cqphm\" (UID: \"f20cb0c1-6f52-41e1-978d-f59baf6bab48\") " pod="kube-system/konnectivity-agent-cqphm" Oct 30 22:07:46.562731 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb1d231f-4920-49d0-bd0c-4a23690b2956-host-slash\") pod \"iptables-alerter-h5z4s\" (UID: \"bb1d231f-4920-49d0-bd0c-4a23690b2956\") " pod="openshift-network-operator/iptables-alerter-h5z4s" Oct 30 22:07:46.562731 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562542 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-sys-fs\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.563298 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562567 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-etc-kubernetes\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.563298 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562581 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01279335-4077-4099-85cb-ec0ed9925c7b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.563298 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9cc4dd2-875f-412d-bf36-880c5f383193-ovn-node-metrics-cert\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.563298 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562668 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-modprobe-d\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.563298 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562726 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8fmp\" (UniqueName: \"kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp\") pod \"network-check-target-chglk\" (UID: \"aec2e919-1d2a-4605-ba3b-d6f973ef036a\") " pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:07:46.563298 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562792 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01279335-4077-4099-85cb-ec0ed9925c7b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.563298 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562821 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-multus-conf-dir\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.563298 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562840 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8a728f8-1427-4a89-8102-6580684a157d-multus-daemon-config\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.563298 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562870 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-kubelet\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.563298 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.562904 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a0a698f-3051-4639-90c8-e4385348feea-tmp\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.563779 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.563762 2564 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 22:07:46.563826 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.563815 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6t9fn" Oct 30 22:07:46.621082 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.621059 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:46.621359 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.621343 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 22:07:46.621441 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.621360 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tmrfp\"" Oct 30 22:07:46.621441 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.621385 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:46.621643 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.621631 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 22:07:46.621702 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.621694 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 22:07:46.621759 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.621721 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 22:07:46.621759 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.621742 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-2djd4\"" Oct 30 22:07:46.621759 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.621747 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-486qv\"" Oct 30 22:07:46.621858 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.621748 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 22:07:46.637670 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.637642 2564 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 22:07:46.637782 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:46.637691 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 22:07:46.637782 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:46.637706 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 22:07:46.637782 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:46.637715 2564 projected.go:196] Error preparing data for projected volume kube-api-access-s8fmp for pod openshift-network-diagnostics/network-check-target-chglk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:46.637782 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:46.637772 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp podName:aec2e919-1d2a-4605-ba3b-d6f973ef036a nodeName:}" failed. No retries permitted until 2026-10-30 22:07:47.137758529 +0000 UTC m=+3.166468457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s8fmp" (UniqueName: "kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp") pod "network-check-target-chglk" (UID: "aec2e919-1d2a-4605-ba3b-d6f973ef036a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:46.641352 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.641315 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrbdv\" (UniqueName: \"kubernetes.io/projected/14afa5d3-bd87-4cb2-9c75-9059d4072250-kube-api-access-qrbdv\") pod \"network-metrics-daemon-thzg4\" (UID: \"14afa5d3-bd87-4cb2-9c75-9059d4072250\") " pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:07:46.641446 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.641336 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7cws\" (UniqueName: \"kubernetes.io/projected/01279335-4077-4099-85cb-ec0ed9925c7b-kube-api-access-g7cws\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.663507 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663486 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-device-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.663564 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-multus-cni-dir\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.663564 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663531 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:07:46.663564 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663549 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f20cb0c1-6f52-41e1-978d-f59baf6bab48-agent-certs\") pod \"konnectivity-agent-cqphm\" (UID: \"f20cb0c1-6f52-41e1-978d-f59baf6bab48\") " pod="kube-system/konnectivity-agent-cqphm" Oct 30 22:07:46.663564 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663554 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-device-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.663737 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663565 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46xsc\" (UniqueName: \"kubernetes.io/projected/bb1d231f-4920-49d0-bd0c-4a23690b2956-kube-api-access-46xsc\") pod \"iptables-alerter-h5z4s\" (UID: \"bb1d231f-4920-49d0-bd0c-4a23690b2956\") " pod="openshift-network-operator/iptables-alerter-h5z4s" Oct 30 22:07:46.663737 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663611 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-run-netns\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.663737 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663637 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-var-lib-kubelet\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.663737 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:46.663657 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:46.663737 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663690 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-multus-cni-dir\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.663737 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663703 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-run-multus-certs\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.663737 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:46.663714 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret podName:1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be nodeName:}" failed. No retries permitted until 2026-10-30 22:07:47.163697126 +0000 UTC m=+3.192407064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret") pod "global-pull-secret-syncer-ztkhr" (UID: "1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be") : object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:46.663737 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663690 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-run-netns\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.664127 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663661 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-run-multus-certs\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.664127 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663739 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-var-lib-kubelet\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.664127 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663782 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-systemd-units\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.664127 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663825 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-log-socket\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.664127 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663826 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-systemd-units\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.664127 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663854 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdb9n\" (UniqueName: \"kubernetes.io/projected/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85-kube-api-access-rdb9n\") pod \"node-resolver-pr5jx\" (UID: \"fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85\") " pod="openshift-dns/node-resolver-pr5jx" Oct 30 22:07:46.664127 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663862 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-log-socket\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.664127 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-kubernetes\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.664127 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663914 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.664127 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663973 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.664127 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.663978 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-kubernetes\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.664127 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664011 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-run-netns\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.664127 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664031 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-node-log\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.664127 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664048 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-run-netns\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.664127 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664058 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f20cb0c1-6f52-41e1-978d-f59baf6bab48-konnectivity-ca\") pod \"konnectivity-agent-cqphm\" (UID: \"f20cb0c1-6f52-41e1-978d-f59baf6bab48\") " pod="kube-system/konnectivity-agent-cqphm" Oct 30 22:07:46.664127 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664086 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb1d231f-4920-49d0-bd0c-4a23690b2956-host-slash\") pod \"iptables-alerter-h5z4s\" (UID: \"bb1d231f-4920-49d0-bd0c-4a23690b2956\") " pod="openshift-network-operator/iptables-alerter-h5z4s" Oct 30 22:07:46.664127 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664090 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-node-log\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.664977 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664111 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-sys-fs\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.664977 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664131 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb1d231f-4920-49d0-bd0c-4a23690b2956-host-slash\") pod \"iptables-alerter-h5z4s\" (UID: \"bb1d231f-4920-49d0-bd0c-4a23690b2956\") " pod="openshift-network-operator/iptables-alerter-h5z4s" Oct 30 22:07:46.664977 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664155 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-etc-kubernetes\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.664977 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664183 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9cc4dd2-875f-412d-bf36-880c5f383193-ovn-node-metrics-cert\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.664977 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664207 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-modprobe-d\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.664977 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664184 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-sys-fs\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.664977 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664243 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-multus-conf-dir\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.664977 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664223 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-etc-kubernetes\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.664977 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664286 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8a728f8-1427-4a89-8102-6580684a157d-multus-daemon-config\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.664977 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664312 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-kubelet\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.664977 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664324 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-multus-conf-dir\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.664977 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664338 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-modprobe-d\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.664977 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664369 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-kubelet\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.664977 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a0a698f-3051-4639-90c8-e4385348feea-tmp\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.664977 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664498 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-cnibin\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.664977 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664519 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f20cb0c1-6f52-41e1-978d-f59baf6bab48-konnectivity-ca\") pod \"konnectivity-agent-cqphm\" (UID: \"f20cb0c1-6f52-41e1-978d-f59baf6bab48\") " pod="kube-system/konnectivity-agent-cqphm" Oct 30 22:07:46.664977 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664544 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.664977 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664569 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-etc-openvswitch\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.665896 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664585 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-cnibin\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.665896 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-run-ovn\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.665896 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664620 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-run-ovn-kubernetes\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.665896 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664628 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.665896 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664630 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-etc-openvswitch\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.665896 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664736 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-sysctl-d\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.665896 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-sysctl-d\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.665896 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664664 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-run-ovn\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.665896 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664692 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-run-ovn-kubernetes\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.665896 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664776 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-systemd\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.665896 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664828 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-socket-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.665896 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664855 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-kubelet-config\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:07:46.665896 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664895 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02b6cf19-863a-4c44-89e9-ccfd393bbf59-serviceca\") pod \"node-ca-rfh52\" (UID: \"02b6cf19-863a-4c44-89e9-ccfd393bbf59\") " pod="openshift-image-registry/node-ca-rfh52" Oct 30 22:07:46.665896 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664908 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-kubelet-config\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:07:46.665896 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664921 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qhkv\" (UniqueName: \"kubernetes.io/projected/02b6cf19-863a-4c44-89e9-ccfd393bbf59-kube-api-access-8qhkv\") pod \"node-ca-rfh52\" (UID: \"02b6cf19-863a-4c44-89e9-ccfd393bbf59\") " pod="openshift-image-registry/node-ca-rfh52" Oct 30 22:07:46.665896 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664958 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-socket-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.665896 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664955 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-var-lib-cni-bin\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.666757 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665001 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-var-lib-cni-bin\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.666757 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665004 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.666757 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664855 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-systemd\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.666757 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665033 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9cc4dd2-875f-412d-bf36-880c5f383193-ovnkube-config\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.666757 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665058 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-run\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.666757 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665082 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5a0a698f-3051-4639-90c8-e4385348feea-etc-tuned\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.666757 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665108 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-run-k8s-cni-cncf-io\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.666757 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665135 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-var-lib-cni-multus\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.666757 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665162 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-slash\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.666757 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665188 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9cc4dd2-875f-412d-bf36-880c5f383193-env-overrides\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.666757 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665213 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85-tmp-dir\") pod \"node-resolver-pr5jx\" (UID: \"fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85\") " pod="openshift-dns/node-resolver-pr5jx" Oct 30 22:07:46.666757 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665253 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-var-lib-openvswitch\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.666757 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.664856 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8a728f8-1427-4a89-8102-6580684a157d-multus-daemon-config\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.666757 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665327 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-var-lib-openvswitch\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.666757 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665332 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02b6cf19-863a-4c44-89e9-ccfd393bbf59-serviceca\") pod \"node-ca-rfh52\" (UID: \"02b6cf19-863a-4c44-89e9-ccfd393bbf59\") " pod="openshift-image-registry/node-ca-rfh52" Oct 30 22:07:46.666757 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665368 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-slash\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.666757 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665427 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-run-k8s-cni-cncf-io\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.666757 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665475 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-var-lib-cni-multus\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.667552 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665676 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85-tmp-dir\") pod \"node-resolver-pr5jx\" (UID: \"fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85\") " pod="openshift-dns/node-resolver-pr5jx" Oct 30 22:07:46.667552 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665761 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-run\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.667552 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665834 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9cc4dd2-875f-412d-bf36-880c5f383193-env-overrides\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.667552 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-cni-bin\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.667552 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665912 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-system-cni-dir\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.667552 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665948 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-multus-socket-dir-parent\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.667552 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665977 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwpl5\" (UniqueName: \"kubernetes.io/projected/5a0a698f-3051-4639-90c8-e4385348feea-kube-api-access-kwpl5\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.667552 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.665980 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.667552 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666001 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9cc4dd2-875f-412d-bf36-880c5f383193-ovnkube-config\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.667552 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666006 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-registration-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.667552 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666037 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-system-cni-dir\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.667552 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666068 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lv7v\" (UniqueName: \"kubernetes.io/projected/d8a728f8-1427-4a89-8102-6580684a157d-kube-api-access-6lv7v\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.667552 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666077 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-cni-bin\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.667552 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666098 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-run-openvswitch\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.667552 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666128 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-sysctl-conf\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.667552 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666133 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-registration-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.667552 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666157 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9cc4dd2-875f-412d-bf36-880c5f383193-ovnkube-script-lib\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.668032 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666180 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-run-openvswitch\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.668032 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666187 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrm8z\" (UniqueName: \"kubernetes.io/projected/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-kube-api-access-zrm8z\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.668032 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666215 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02b6cf19-863a-4c44-89e9-ccfd393bbf59-host\") pod \"node-ca-rfh52\" (UID: \"02b6cf19-863a-4c44-89e9-ccfd393bbf59\") " pod="openshift-image-registry/node-ca-rfh52" Oct 30 22:07:46.668032 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666241 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-dbus\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:07:46.668032 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666258 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-multus-socket-dir-parent\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.668032 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666267 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85-hosts-file\") pod \"node-resolver-pr5jx\" (UID: \"fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85\") " pod="openshift-dns/node-resolver-pr5jx" Oct 30 22:07:46.668032 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666339 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02b6cf19-863a-4c44-89e9-ccfd393bbf59-host\") pod \"node-ca-rfh52\" (UID: \"02b6cf19-863a-4c44-89e9-ccfd393bbf59\") " pod="openshift-image-registry/node-ca-rfh52" Oct 30 22:07:46.668032 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666400 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-dbus\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:07:46.668032 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-host\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.668032 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666457 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-hostroot\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.668032 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666458 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85-hosts-file\") pod \"node-resolver-pr5jx\" (UID: \"fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85\") " pod="openshift-dns/node-resolver-pr5jx" Oct 30 22:07:46.668032 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666508 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-host\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.668032 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666514 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-hostroot\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.668032 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666544 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lbss\" (UniqueName: \"kubernetes.io/projected/a9cc4dd2-875f-412d-bf36-880c5f383193-kube-api-access-8lbss\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.668032 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666573 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb1d231f-4920-49d0-bd0c-4a23690b2956-iptables-alerter-script\") pod \"iptables-alerter-h5z4s\" (UID: \"bb1d231f-4920-49d0-bd0c-4a23690b2956\") " pod="openshift-network-operator/iptables-alerter-h5z4s" Oct 30 22:07:46.668032 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666570 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-sysctl-conf\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.668032 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8a728f8-1427-4a89-8102-6580684a157d-cni-binary-copy\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.668032 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666729 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-run-systemd\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.668570 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666754 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-cni-netd\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.668570 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666780 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-sysconfig\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.668570 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666805 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-sys\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.668570 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666811 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9cc4dd2-875f-412d-bf36-880c5f383193-ovnkube-script-lib\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.668570 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666832 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-lib-modules\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.668570 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666859 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-var-lib-kubelet\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.668570 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666889 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-sysconfig\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.668570 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666933 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-cni-netd\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.668570 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666940 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-run-systemd\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.668570 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.666966 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-var-lib-kubelet\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.668570 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.667003 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-sys\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.668570 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.667031 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f20cb0c1-6f52-41e1-978d-f59baf6bab48-agent-certs\") pod \"konnectivity-agent-cqphm\" (UID: \"f20cb0c1-6f52-41e1-978d-f59baf6bab48\") " pod="kube-system/konnectivity-agent-cqphm" Oct 30 22:07:46.668570 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.667049 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-lib-modules\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.668570 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.667212 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb1d231f-4920-49d0-bd0c-4a23690b2956-iptables-alerter-script\") pod \"iptables-alerter-h5z4s\" (UID: \"bb1d231f-4920-49d0-bd0c-4a23690b2956\") " pod="openshift-network-operator/iptables-alerter-h5z4s" Oct 30 22:07:46.668570 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.667225 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a0a698f-3051-4639-90c8-e4385348feea-tmp\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.668570 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.667273 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9cc4dd2-875f-412d-bf36-880c5f383193-ovn-node-metrics-cert\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.668570 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.667304 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8a728f8-1427-4a89-8102-6580684a157d-cni-binary-copy\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.668570 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.667653 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5a0a698f-3051-4639-90c8-e4385348feea-etc-tuned\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.749001 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.748770 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qhkv\" (UniqueName: \"kubernetes.io/projected/02b6cf19-863a-4c44-89e9-ccfd393bbf59-kube-api-access-8qhkv\") pod \"node-ca-rfh52\" (UID: \"02b6cf19-863a-4c44-89e9-ccfd393bbf59\") " pod="openshift-image-registry/node-ca-rfh52" Oct 30 22:07:46.749001 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.748911 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lv7v\" (UniqueName: \"kubernetes.io/projected/d8a728f8-1427-4a89-8102-6580684a157d-kube-api-access-6lv7v\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.749593 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.749567 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46xsc\" (UniqueName: \"kubernetes.io/projected/bb1d231f-4920-49d0-bd0c-4a23690b2956-kube-api-access-46xsc\") pod \"iptables-alerter-h5z4s\" (UID: \"bb1d231f-4920-49d0-bd0c-4a23690b2956\") " pod="openshift-network-operator/iptables-alerter-h5z4s" Oct 30 22:07:46.749694 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.749570 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdb9n\" (UniqueName: \"kubernetes.io/projected/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85-kube-api-access-rdb9n\") pod \"node-resolver-pr5jx\" (UID: \"fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85\") " pod="openshift-dns/node-resolver-pr5jx" Oct 30 22:07:46.749815 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.749797 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrm8z\" (UniqueName: \"kubernetes.io/projected/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-kube-api-access-zrm8z\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.749964 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.749944 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lbss\" (UniqueName: \"kubernetes.io/projected/a9cc4dd2-875f-412d-bf36-880c5f383193-kube-api-access-8lbss\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.750763 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.750744 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwpl5\" (UniqueName: \"kubernetes.io/projected/5a0a698f-3051-4639-90c8-e4385348feea-kube-api-access-kwpl5\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.780305 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.780289 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rfh52" Oct 30 22:07:46.782447 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.782432 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:07:46.785489 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.785472 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:07:46.786331 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.786288 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gwx2d" Oct 30 22:07:46.793420 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:46.793398 2564 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02b6cf19_863a_4c44_89e9_ccfd393bbf59.slice/crio-665daed85bfa910e74dc6f2e893cc30d8b769f68613a0b179b35f921fb2667da WatchSource:0}: Error finding container 665daed85bfa910e74dc6f2e893cc30d8b769f68613a0b179b35f921fb2667da: Status 404 returned error can't find the container with id 665daed85bfa910e74dc6f2e893cc30d8b769f68613a0b179b35f921fb2667da Oct 30 22:07:46.794276 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:46.794102 2564 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01279335_4077_4099_85cb_ec0ed9925c7b.slice/crio-90220cac142f748324925c4cee506ff4ac60528f1a06e77eb39822b636fb788a WatchSource:0}: Error finding container 90220cac142f748324925c4cee506ff4ac60528f1a06e77eb39822b636fb788a: Status 404 returned error can't find the container with id 90220cac142f748324925c4cee506ff4ac60528f1a06e77eb39822b636fb788a Oct 30 22:07:46.796812 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.796795 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pr5jx" Oct 30 22:07:46.797835 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:46.797808 2564 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4e3e6b_42e3_4ebd_ac88_8b45ab253747.slice/crio-9b1b5120282bb0179ed0d02db0a93c8b6acbcd92151efadc27b4764c7370090c WatchSource:0}: Error finding container 9b1b5120282bb0179ed0d02db0a93c8b6acbcd92151efadc27b4764c7370090c: Status 404 returned error can't find the container with id 9b1b5120282bb0179ed0d02db0a93c8b6acbcd92151efadc27b4764c7370090c Oct 30 22:07:46.799131 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.799111 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cqphm" Oct 30 22:07:46.800577 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:46.800537 2564 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8a728f8_1427_4a89_8102_6580684a157d.slice/crio-1d7a636fb33e6d7987bf570cb33b4fdaea46d437ef7a1bc2d163daf381e66496 WatchSource:0}: Error finding container 1d7a636fb33e6d7987bf570cb33b4fdaea46d437ef7a1bc2d163daf381e66496: Status 404 returned error can't find the container with id 1d7a636fb33e6d7987bf570cb33b4fdaea46d437ef7a1bc2d163daf381e66496 Oct 30 22:07:46.807963 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.807942 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:07:46.808167 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:46.808147 2564 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc8c5ac0_1a8f_4a7d_bb63_65d5f6119c85.slice/crio-195583dc2da7f59055751d45111553bba6c59bcd5ac786037ea4b8e64012eb46 WatchSource:0}: Error finding container 195583dc2da7f59055751d45111553bba6c59bcd5ac786037ea4b8e64012eb46: Status 404 returned error can't find the container with id 195583dc2da7f59055751d45111553bba6c59bcd5ac786037ea4b8e64012eb46 Oct 30 22:07:46.810246 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.810226 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h5z4s" Oct 30 22:07:46.810703 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:46.810684 2564 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf20cb0c1_6f52_41e1_978d_f59baf6bab48.slice/crio-af95f661f18489f4c1825303f5b9498d748f459ad7a32accac26550a33ef1aee WatchSource:0}: Error finding container af95f661f18489f4c1825303f5b9498d748f459ad7a32accac26550a33ef1aee: Status 404 returned error can't find the container with id af95f661f18489f4c1825303f5b9498d748f459ad7a32accac26550a33ef1aee Oct 30 22:07:46.812329 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:46.812223 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:07:46.818580 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:46.818564 2564 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9cc4dd2_875f_412d_bf36_880c5f383193.slice/crio-20dbd160a27db871823d4261813f17186718bdc3a8aebd7ebf47260d3c714d87 WatchSource:0}: Error finding container 20dbd160a27db871823d4261813f17186718bdc3a8aebd7ebf47260d3c714d87: Status 404 returned error can't find the container with id 20dbd160a27db871823d4261813f17186718bdc3a8aebd7ebf47260d3c714d87 Oct 30 22:07:46.821801 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:46.821781 2564 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1d231f_4920_49d0_bd0c_4a23690b2956.slice/crio-0adc30f27969d0ffff12733118e1fc30cec6134ebe5f9e7c31daadf260e878e3 WatchSource:0}: Error finding container 0adc30f27969d0ffff12733118e1fc30cec6134ebe5f9e7c31daadf260e878e3: Status 404 returned error can't find the container with id 0adc30f27969d0ffff12733118e1fc30cec6134ebe5f9e7c31daadf260e878e3 Oct 30 22:07:46.825213 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:07:46.825123 2564 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a0a698f_3051_4639_90c8_e4385348feea.slice/crio-06ed5ed8825ddbebc454a9716c1be9c06df3428060f5eb872096dc0547e4fe78 WatchSource:0}: Error finding container 06ed5ed8825ddbebc454a9716c1be9c06df3428060f5eb872096dc0547e4fe78: Status 404 returned error can't find the container with id 06ed5ed8825ddbebc454a9716c1be9c06df3428060f5eb872096dc0547e4fe78 Oct 30 22:07:47.070561 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:47.070486 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs\") pod \"network-metrics-daemon-thzg4\" (UID: \"14afa5d3-bd87-4cb2-9c75-9059d4072250\") " pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:07:47.070714 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:47.070691 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:47.070781 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:47.070747 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs podName:14afa5d3-bd87-4cb2-9c75-9059d4072250 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:48.070732462 +0000 UTC m=+4.099442387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs") pod "network-metrics-daemon-thzg4" (UID: "14afa5d3-bd87-4cb2-9c75-9059d4072250") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:47.171949 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:47.171713 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8fmp\" (UniqueName: \"kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp\") pod \"network-check-target-chglk\" (UID: \"aec2e919-1d2a-4605-ba3b-d6f973ef036a\") " pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:07:47.171949 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:47.171810 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:07:47.171949 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:47.171835 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 22:07:47.171949 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:47.171854 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 22:07:47.171949 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:47.171864 2564 projected.go:196] Error preparing data for projected volume kube-api-access-s8fmp for pod openshift-network-diagnostics/network-check-target-chglk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:47.171949 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:47.171917 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:47.172320 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:47.171920 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp podName:aec2e919-1d2a-4605-ba3b-d6f973ef036a nodeName:}" failed. No retries permitted until 2026-10-30 22:07:48.171899343 +0000 UTC m=+4.200609252 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s8fmp" (UniqueName: "kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp") pod "network-check-target-chglk" (UID: "aec2e919-1d2a-4605-ba3b-d6f973ef036a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:47.172320 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:47.171988 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret podName:1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be nodeName:}" failed. No retries permitted until 2026-10-30 22:07:48.171971355 +0000 UTC m=+4.200681270 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret") pod "global-pull-secret-syncer-ztkhr" (UID: "1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be") : object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:47.438858 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:47.438763 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rfh52" event={"ID":"02b6cf19-863a-4c44-89e9-ccfd393bbf59","Type":"ContainerStarted","Data":"665daed85bfa910e74dc6f2e893cc30d8b769f68613a0b179b35f921fb2667da"} Oct 30 22:07:47.440383 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:47.440353 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pr5jx" event={"ID":"fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85","Type":"ContainerStarted","Data":"195583dc2da7f59055751d45111553bba6c59bcd5ac786037ea4b8e64012eb46"} Oct 30 22:07:47.441975 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:47.441926 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gwx2d" event={"ID":"d8a728f8-1427-4a89-8102-6580684a157d","Type":"ContainerStarted","Data":"1d7a636fb33e6d7987bf570cb33b4fdaea46d437ef7a1bc2d163daf381e66496"} Oct 30 22:07:47.443540 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:47.443514 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" event={"ID":"be4e3e6b-42e3-4ebd-ac88-8b45ab253747","Type":"ContainerStarted","Data":"9b1b5120282bb0179ed0d02db0a93c8b6acbcd92151efadc27b4764c7370090c"} Oct 30 22:07:47.444785 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:47.444761 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-69mlp" event={"ID":"5a0a698f-3051-4639-90c8-e4385348feea","Type":"ContainerStarted","Data":"06ed5ed8825ddbebc454a9716c1be9c06df3428060f5eb872096dc0547e4fe78"} Oct 30 22:07:47.446166 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:47.446141 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h5z4s" event={"ID":"bb1d231f-4920-49d0-bd0c-4a23690b2956","Type":"ContainerStarted","Data":"0adc30f27969d0ffff12733118e1fc30cec6134ebe5f9e7c31daadf260e878e3"} Oct 30 22:07:47.447903 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:47.447819 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" event={"ID":"a9cc4dd2-875f-412d-bf36-880c5f383193","Type":"ContainerStarted","Data":"20dbd160a27db871823d4261813f17186718bdc3a8aebd7ebf47260d3c714d87"} Oct 30 22:07:47.449159 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:47.449134 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cqphm" event={"ID":"f20cb0c1-6f52-41e1-978d-f59baf6bab48","Type":"ContainerStarted","Data":"af95f661f18489f4c1825303f5b9498d748f459ad7a32accac26550a33ef1aee"} Oct 30 22:07:47.450586 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:47.450565 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmvbh" event={"ID":"01279335-4077-4099-85cb-ec0ed9925c7b","Type":"ContainerStarted","Data":"90220cac142f748324925c4cee506ff4ac60528f1a06e77eb39822b636fb788a"} Oct 30 22:07:47.567739 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:47.567674 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 22:02:46 +0000 UTC" deadline="2028-06-21 15:32:07.090447325 +0000 UTC" Oct 30 22:07:47.567895 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:47.567744 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14393h24m19.522708461s" Oct 30 22:07:48.080148 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:48.080113 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs\") pod \"network-metrics-daemon-thzg4\" (UID: \"14afa5d3-bd87-4cb2-9c75-9059d4072250\") " pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:07:48.080439 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:48.080409 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:48.080531 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:48.080524 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs podName:14afa5d3-bd87-4cb2-9c75-9059d4072250 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:50.080478247 +0000 UTC m=+6.109188173 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs") pod "network-metrics-daemon-thzg4" (UID: "14afa5d3-bd87-4cb2-9c75-9059d4072250") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:48.180934 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:48.180885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:07:48.181124 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:48.180947 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8fmp\" (UniqueName: \"kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp\") pod \"network-check-target-chglk\" (UID: \"aec2e919-1d2a-4605-ba3b-d6f973ef036a\") " pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:07:48.181195 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:48.181132 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 22:07:48.181195 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:48.181155 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 22:07:48.181195 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:48.181169 2564 projected.go:196] Error preparing data for projected volume kube-api-access-s8fmp for pod openshift-network-diagnostics/network-check-target-chglk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:48.181383 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:48.181227 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp podName:aec2e919-1d2a-4605-ba3b-d6f973ef036a nodeName:}" failed. No retries permitted until 2026-10-30 22:07:50.181208665 +0000 UTC m=+6.209918590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s8fmp" (UniqueName: "kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp") pod "network-check-target-chglk" (UID: "aec2e919-1d2a-4605-ba3b-d6f973ef036a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:48.181383 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:48.181325 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:48.181383 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:48.181367 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret podName:1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be nodeName:}" failed. No retries permitted until 2026-10-30 22:07:50.181353364 +0000 UTC m=+6.210063294 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret") pod "global-pull-secret-syncer-ztkhr" (UID: "1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be") : object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:48.445526 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:48.445484 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:07:48.446039 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:48.445537 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:07:48.446039 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:48.445700 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thzg4" podUID="14afa5d3-bd87-4cb2-9c75-9059d4072250" Oct 30 22:07:48.446039 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:48.445875 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztkhr" podUID="1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be" Oct 30 22:07:48.446211 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:48.446047 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:07:48.446262 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:48.446209 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chglk" podUID="aec2e919-1d2a-4605-ba3b-d6f973ef036a" Oct 30 22:07:48.568597 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:48.568527 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 22:02:46 +0000 UTC" deadline="2028-08-12 18:09:37.21709721 +0000 UTC" Oct 30 22:07:48.568597 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:48.568595 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15644h1m48.648506706s" Oct 30 22:07:50.103374 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:50.101598 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs\") pod \"network-metrics-daemon-thzg4\" (UID: \"14afa5d3-bd87-4cb2-9c75-9059d4072250\") " pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:07:50.103374 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:50.102021 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:50.103374 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:50.102090 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs podName:14afa5d3-bd87-4cb2-9c75-9059d4072250 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:54.102069102 +0000 UTC m=+10.130779027 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs") pod "network-metrics-daemon-thzg4" (UID: "14afa5d3-bd87-4cb2-9c75-9059d4072250") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:50.202546 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:50.202512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:07:50.202676 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:50.202578 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8fmp\" (UniqueName: \"kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp\") pod \"network-check-target-chglk\" (UID: \"aec2e919-1d2a-4605-ba3b-d6f973ef036a\") " pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:07:50.202733 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:50.202725 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 22:07:50.202799 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:50.202743 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 22:07:50.202799 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:50.202756 2564 projected.go:196] Error preparing data for projected volume kube-api-access-s8fmp for pod openshift-network-diagnostics/network-check-target-chglk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:50.202910 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:50.202811 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp podName:aec2e919-1d2a-4605-ba3b-d6f973ef036a nodeName:}" failed. No retries permitted until 2026-10-30 22:07:54.202793761 +0000 UTC m=+10.231503671 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s8fmp" (UniqueName: "kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp") pod "network-check-target-chglk" (UID: "aec2e919-1d2a-4605-ba3b-d6f973ef036a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:50.202910 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:50.202878 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:50.202910 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:50.202910 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret podName:1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be nodeName:}" failed. No retries permitted until 2026-10-30 22:07:54.202899624 +0000 UTC m=+10.231609534 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret") pod "global-pull-secret-syncer-ztkhr" (UID: "1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be") : object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:50.428507 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:50.428473 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:07:50.428652 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:50.428519 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:07:50.428652 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:50.428630 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztkhr" podUID="1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be" Oct 30 22:07:50.428753 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:50.428735 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thzg4" podUID="14afa5d3-bd87-4cb2-9c75-9059d4072250" Oct 30 22:07:50.428791 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:50.428783 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:07:50.428870 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:50.428852 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chglk" podUID="aec2e919-1d2a-4605-ba3b-d6f973ef036a" Oct 30 22:07:50.477967 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:50.477928 2564 generic.go:356] "Generic (PLEG): container finished" podID="a0c404c8d77f01c057faf5619397a983" containerID="0f948638a55df585021b8f29d3b7e041dd49c1f0d928b81ace7206f1f3aaea5f" exitCode=0 Oct 30 22:07:50.478092 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:50.478029 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" event={"ID":"a0c404c8d77f01c057faf5619397a983","Type":"ContainerDied","Data":"0f948638a55df585021b8f29d3b7e041dd49c1f0d928b81ace7206f1f3aaea5f"} Oct 30 22:07:50.482196 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:50.482051 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal" event={"ID":"b1d3741bfbe7d5cade012c8699af4bf8","Type":"ContainerStarted","Data":"2b6d5c9ebe1052f1296c45ab5ffaee607651a0b6bcf613cb9f874bee59dadb88"} Oct 30 22:07:51.499723 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:51.498341 2564 generic.go:356] "Generic (PLEG): container finished" podID="01279335-4077-4099-85cb-ec0ed9925c7b" containerID="6218cde8202e78a5a7a45c37b47111e3ee15e33f9c6af216c86f6c0e29152bb9" exitCode=0 Oct 30 22:07:51.499723 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:51.498451 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmvbh" event={"ID":"01279335-4077-4099-85cb-ec0ed9925c7b","Type":"ContainerDied","Data":"6218cde8202e78a5a7a45c37b47111e3ee15e33f9c6af216c86f6c0e29152bb9"} Oct 30 22:07:51.512828 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:51.511974 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" event={"ID":"a0c404c8d77f01c057faf5619397a983","Type":"ContainerStarted","Data":"66cb1413668a585c36d3b845605ae4a58677962ac5690c5cca50b4fce8fb0529"} Oct 30 22:07:51.738629 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:51.738517 2564 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal" podStartSLOduration=5.738503379 podStartE2EDuration="5.738503379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:50.738491121 +0000 UTC m=+6.767201053" watchObservedRunningTime="2026-10-30 22:07:51.738503379 +0000 UTC m=+7.767213313" Oct 30 22:07:52.428815 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:52.428781 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:07:52.428989 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:52.428946 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thzg4" podUID="14afa5d3-bd87-4cb2-9c75-9059d4072250" Oct 30 22:07:52.429055 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:52.429020 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:07:52.429130 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:52.429090 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chglk" podUID="aec2e919-1d2a-4605-ba3b-d6f973ef036a" Oct 30 22:07:52.429185 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:52.429143 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:07:52.429241 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:52.429213 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztkhr" podUID="1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be" Oct 30 22:07:52.517217 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:52.517184 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cqphm" event={"ID":"f20cb0c1-6f52-41e1-978d-f59baf6bab48","Type":"ContainerStarted","Data":"cacc8f66eb241242a25a0266bd0a8a7fc29dd02acad06ec3966098fc71631a38"} Oct 30 22:07:52.642638 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:52.641837 2564 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" podStartSLOduration=6.641814346 podStartE2EDuration="6.641814346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:51.864683898 +0000 UTC m=+7.893393834" watchObservedRunningTime="2026-10-30 22:07:52.641814346 +0000 UTC m=+8.670524276" Oct 30 22:07:52.642638 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:52.642058 2564 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cqphm" podStartSLOduration=3.095588662 podStartE2EDuration="7.642049504s" totalImagesPullingTime="4.546460842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:52.6412035 +0000 UTC m=+8.669913433" watchObservedRunningTime="2026-10-30 22:07:52.642049504 +0000 UTC m=+8.670759434" Oct 30 22:07:52.645974 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:52.645945 2564 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cqphm" Oct 30 22:07:52.647280 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:52.646630 2564 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cqphm" Oct 30 22:07:53.529096 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:53.527018 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rfh52" event={"ID":"02b6cf19-863a-4c44-89e9-ccfd393bbf59","Type":"ContainerStarted","Data":"66e3bdfa4537c46e7d0db15fb48708813fcce18d1957ba2f620a81370f5ac5b8"} Oct 30 22:07:53.529096 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:53.527112 2564 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cqphm" Oct 30 22:07:53.538728 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:53.538528 2564 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cqphm" Oct 30 22:07:53.773862 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:53.773462 2564 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rfh52" podStartSLOduration=3.014362196 podStartE2EDuration="8.773440382s" totalImagesPullingTime="5.759078186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:53.647166301 +0000 UTC m=+9.675876229" watchObservedRunningTime="2026-10-30 22:07:53.773440382 +0000 UTC m=+9.802150383" Oct 30 22:07:54.134269 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:54.134177 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs\") pod \"network-metrics-daemon-thzg4\" (UID: \"14afa5d3-bd87-4cb2-9c75-9059d4072250\") " pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:07:54.134425 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:54.134372 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:54.134425 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:54.134419 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs podName:14afa5d3-bd87-4cb2-9c75-9059d4072250 nodeName:}" failed. No retries permitted until 2026-10-30 22:08:02.134404474 +0000 UTC m=+18.163114392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs") pod "network-metrics-daemon-thzg4" (UID: "14afa5d3-bd87-4cb2-9c75-9059d4072250") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:54.235522 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:54.235488 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:07:54.235678 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:54.235547 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8fmp\" (UniqueName: \"kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp\") pod \"network-check-target-chglk\" (UID: \"aec2e919-1d2a-4605-ba3b-d6f973ef036a\") " pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:07:54.235757 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:54.235701 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 22:07:54.235757 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:54.235718 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 22:07:54.235757 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:54.235731 2564 projected.go:196] Error preparing data for projected volume kube-api-access-s8fmp for pod openshift-network-diagnostics/network-check-target-chglk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:54.235906 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:54.235781 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp podName:aec2e919-1d2a-4605-ba3b-d6f973ef036a nodeName:}" failed. No retries permitted until 2026-10-30 22:08:02.235764991 +0000 UTC m=+18.264474899 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s8fmp" (UniqueName: "kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp") pod "network-check-target-chglk" (UID: "aec2e919-1d2a-4605-ba3b-d6f973ef036a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:54.235906 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:54.235849 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:54.235906 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:54.235883 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret podName:1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be nodeName:}" failed. No retries permitted until 2026-10-30 22:08:02.235871097 +0000 UTC m=+18.264581017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret") pod "global-pull-secret-syncer-ztkhr" (UID: "1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be") : object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:54.430646 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:54.430579 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:07:54.430797 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:54.430693 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thzg4" podUID="14afa5d3-bd87-4cb2-9c75-9059d4072250" Oct 30 22:07:54.430797 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:54.430760 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:07:54.430914 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:54.430839 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chglk" podUID="aec2e919-1d2a-4605-ba3b-d6f973ef036a" Oct 30 22:07:54.431013 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:54.430995 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:07:54.431109 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:54.431088 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztkhr" podUID="1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be" Oct 30 22:07:54.531095 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:54.531058 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" event={"ID":"be4e3e6b-42e3-4ebd-ac88-8b45ab253747","Type":"ContainerStarted","Data":"b6134d3a1309ca033c879643b3f322941c64a2364d5df54208952670ebaea08c"} Oct 30 22:07:55.539461 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:55.539429 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gwx2d" event={"ID":"d8a728f8-1427-4a89-8102-6580684a157d","Type":"ContainerStarted","Data":"dcde5b413f212369fae76968e51376698b420fee0e1f406b749e26e49b3eb836"} Oct 30 22:07:55.657598 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:55.657553 2564 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-gwx2d" podStartSLOduration=2.104359044 podStartE2EDuration="10.657540211s" totalImagesPullingTime="8.553181167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:55.656990358 +0000 UTC m=+11.685700285" watchObservedRunningTime="2026-10-30 22:07:55.657540211 +0000 UTC m=+11.686250138" Oct 30 22:07:55.728715 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:55.728688 2564 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 22:07:56.428606 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:56.428578 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:07:56.428751 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:56.428704 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztkhr" podUID="1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be" Oct 30 22:07:56.428811 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:56.428781 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:07:56.428906 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:56.428890 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thzg4" podUID="14afa5d3-bd87-4cb2-9c75-9059d4072250" Oct 30 22:07:56.428967 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:56.428954 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:07:56.429037 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:56.429020 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chglk" podUID="aec2e919-1d2a-4605-ba3b-d6f973ef036a" Oct 30 22:07:56.431357 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:56.431212 2564 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T22:07:55.728713789Z","UUID":"b8fcb03b-de33-4d2b-97f4-0ae6e65d59ef","Handler":null,"Name":"","Endpoint":""} Oct 30 22:07:56.432714 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:56.432693 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 22:07:56.432841 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:56.432723 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 22:07:56.543079 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:56.543045 2564 generic.go:356] "Generic (PLEG): container finished" podID="01279335-4077-4099-85cb-ec0ed9925c7b" containerID="f05fd56b41ed0948817d82cd17f18b2fa4ed00e8c98bdb43b7ad7f6863d91a43" exitCode=0 Oct 30 22:07:56.543572 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:56.543106 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmvbh" event={"ID":"01279335-4077-4099-85cb-ec0ed9925c7b","Type":"ContainerDied","Data":"f05fd56b41ed0948817d82cd17f18b2fa4ed00e8c98bdb43b7ad7f6863d91a43"} Oct 30 22:07:56.545923 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:56.545899 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pr5jx" event={"ID":"fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85","Type":"ContainerStarted","Data":"27dbfb8f6a1932529b9f50165a682235bfab68c2734827ebf5874ee2ef6bef52"} Oct 30 22:07:56.548300 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:56.548274 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" event={"ID":"be4e3e6b-42e3-4ebd-ac88-8b45ab253747","Type":"ContainerStarted","Data":"99e16ed83caa5989291bd1392d836f4fb965b3ca36245a78a64501e80dcd4529"} Oct 30 22:07:56.778874 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:56.778820 2564 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-pr5jx" podStartSLOduration=3.12345255 podStartE2EDuration="11.778802456s" totalImagesPullingTime="8.655349906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:56.778594027 +0000 UTC m=+12.807303955" watchObservedRunningTime="2026-10-30 22:07:56.778802456 +0000 UTC m=+12.807512384" Oct 30 22:07:57.555294 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:57.555261 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h5z4s" event={"ID":"bb1d231f-4920-49d0-bd0c-4a23690b2956","Type":"ContainerStarted","Data":"e52703e05547b126127ca14f67810dc8b2280ea4f71c9b532cabc240f581c9cf"} Oct 30 22:07:57.670762 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:57.670583 2564 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h5z4s" podStartSLOduration=3.5014582 podStartE2EDuration="12.67057099s" totalImagesPullingTime="9.16911279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:57.67046174 +0000 UTC m=+13.699171669" watchObservedRunningTime="2026-10-30 22:07:57.67057099 +0000 UTC m=+13.699280918" Oct 30 22:07:58.426517 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:58.426399 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:07:58.426517 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:58.426409 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:07:58.426705 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:58.426557 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:07:58.426705 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:58.426557 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztkhr" podUID="1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be" Oct 30 22:07:58.426705 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:58.426678 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chglk" podUID="aec2e919-1d2a-4605-ba3b-d6f973ef036a" Oct 30 22:07:58.426864 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:07:58.426770 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thzg4" podUID="14afa5d3-bd87-4cb2-9c75-9059d4072250" Oct 30 22:07:58.559219 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:58.559179 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" event={"ID":"be4e3e6b-42e3-4ebd-ac88-8b45ab253747","Type":"ContainerStarted","Data":"5a6ca4ac99e6a9ceadb3c665c32025169bdad936b3bbb1d6dc7824a5ff9e62d0"} Oct 30 22:07:58.560850 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:58.560817 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-69mlp" event={"ID":"5a0a698f-3051-4639-90c8-e4385348feea","Type":"ContainerStarted","Data":"7bb5a8f1efdcfcb4b47c4ebf825f509da579dc08fbc4e241bbdb3d54912c03ba"} Oct 30 22:07:58.563157 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:58.563133 2564 generic.go:356] "Generic (PLEG): container finished" podID="01279335-4077-4099-85cb-ec0ed9925c7b" containerID="7827f32081e9a159936a87d0b154d7a33e9c1e020be4e3e7295ed31704646e74" exitCode=0 Oct 30 22:07:58.563308 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:58.563216 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmvbh" event={"ID":"01279335-4077-4099-85cb-ec0ed9925c7b","Type":"ContainerDied","Data":"7827f32081e9a159936a87d0b154d7a33e9c1e020be4e3e7295ed31704646e74"} Oct 30 22:07:58.799689 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:58.799591 2564 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" podStartSLOduration=3.179811739 podStartE2EDuration="13.799572845s" totalImagesPullingTime="10.619761106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:58.681781869 +0000 UTC m=+14.710491798" watchObservedRunningTime="2026-10-30 22:07:58.799572845 +0000 UTC m=+14.828282774" Oct 30 22:07:58.799952 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:07:58.799918 2564 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-69mlp" podStartSLOduration=2.613366884 podStartE2EDuration="13.799910915s" totalImagesPullingTime="11.186544031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:58.799113486 +0000 UTC m=+14.827823440" watchObservedRunningTime="2026-10-30 22:07:58.799910915 +0000 UTC m=+14.828620843" Oct 30 22:08:00.426145 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:00.426111 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:08:00.426145 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:00.426130 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:00.426953 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:00.426223 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chglk" podUID="aec2e919-1d2a-4605-ba3b-d6f973ef036a" Oct 30 22:08:00.426953 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:00.426371 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thzg4" podUID="14afa5d3-bd87-4cb2-9c75-9059d4072250" Oct 30 22:08:00.426953 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:00.426433 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:00.426953 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:00.426511 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztkhr" podUID="1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be" Oct 30 22:08:00.570379 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:00.570332 2564 generic.go:356] "Generic (PLEG): container finished" podID="01279335-4077-4099-85cb-ec0ed9925c7b" containerID="20893e6c6664d3fc5cd159bc7ebe34d5c5d46725638afde53c2529208b587570" exitCode=0 Oct 30 22:08:00.570531 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:00.570392 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmvbh" event={"ID":"01279335-4077-4099-85cb-ec0ed9925c7b","Type":"ContainerDied","Data":"20893e6c6664d3fc5cd159bc7ebe34d5c5d46725638afde53c2529208b587570"} Oct 30 22:08:02.195485 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:02.195458 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs\") pod \"network-metrics-daemon-thzg4\" (UID: \"14afa5d3-bd87-4cb2-9c75-9059d4072250\") " pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:02.195895 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:02.195595 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:08:02.195895 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:02.195650 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs podName:14afa5d3-bd87-4cb2-9c75-9059d4072250 nodeName:}" failed. No retries permitted until 2026-10-30 22:08:18.19563637 +0000 UTC m=+34.224346275 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs") pod "network-metrics-daemon-thzg4" (UID: "14afa5d3-bd87-4cb2-9c75-9059d4072250") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:08:02.296416 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:02.296387 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:02.296578 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:02.296429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8fmp\" (UniqueName: \"kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp\") pod \"network-check-target-chglk\" (UID: \"aec2e919-1d2a-4605-ba3b-d6f973ef036a\") " pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:08:02.296578 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:02.296540 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 22:08:02.296578 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:02.296544 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 22:08:02.296578 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:02.296555 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 22:08:02.296578 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:02.296565 2564 projected.go:196] Error preparing data for projected volume kube-api-access-s8fmp for pod openshift-network-diagnostics/network-check-target-chglk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:08:02.296787 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:02.296617 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret podName:1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be nodeName:}" failed. No retries permitted until 2026-10-30 22:08:18.296596603 +0000 UTC m=+34.325306525 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret") pod "global-pull-secret-syncer-ztkhr" (UID: "1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be") : object "kube-system"/"original-pull-secret" not registered Oct 30 22:08:02.296787 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:02.296638 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp podName:aec2e919-1d2a-4605-ba3b-d6f973ef036a nodeName:}" failed. No retries permitted until 2026-10-30 22:08:18.296628519 +0000 UTC m=+34.325338447 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s8fmp" (UniqueName: "kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp") pod "network-check-target-chglk" (UID: "aec2e919-1d2a-4605-ba3b-d6f973ef036a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:08:02.426501 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:02.426471 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:02.426501 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:02.426501 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:02.426692 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:02.426673 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thzg4" podUID="14afa5d3-bd87-4cb2-9c75-9059d4072250" Oct 30 22:08:02.427059 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:02.427036 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztkhr" podUID="1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be" Oct 30 22:08:02.427121 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:02.427082 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:08:02.427163 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:02.427148 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chglk" podUID="aec2e919-1d2a-4605-ba3b-d6f973ef036a" Oct 30 22:08:03.581566 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:03.581189 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" event={"ID":"a9cc4dd2-875f-412d-bf36-880c5f383193","Type":"ContainerStarted","Data":"83b6eaec71d8d3f18489e1bdd0705227ce70cf2d1e6fcbf0157fb21bf864a59d"} Oct 30 22:08:03.581990 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:03.581635 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" event={"ID":"a9cc4dd2-875f-412d-bf36-880c5f383193","Type":"ContainerStarted","Data":"09f8c55776d37d29a59dafe2daa4a830891d08e13cfbdd5031563811666cc908"} Oct 30 22:08:03.581990 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:03.581690 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" event={"ID":"a9cc4dd2-875f-412d-bf36-880c5f383193","Type":"ContainerStarted","Data":"1cfd2c00212ffbd1d74fd9ceba862455f6420c7880aec655c051828789efc66c"} Oct 30 22:08:03.581990 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:03.581723 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" event={"ID":"a9cc4dd2-875f-412d-bf36-880c5f383193","Type":"ContainerStarted","Data":"e915b7b363f60a495fc65072d6278f11f7ea91260714418525ebdef30c53433a"} Oct 30 22:08:03.581990 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:03.581766 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" event={"ID":"a9cc4dd2-875f-412d-bf36-880c5f383193","Type":"ContainerStarted","Data":"70a04fd81f2def5cf443596402412a05e6ca8c738b6902938eab2a26610ad8ec"} Oct 30 22:08:03.581990 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:03.581797 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" event={"ID":"a9cc4dd2-875f-412d-bf36-880c5f383193","Type":"ContainerStarted","Data":"7af7268b98ef08de766e239faed9775d16ab7e27790a813865bca56445d86031"} Oct 30 22:08:03.583908 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:03.583883 2564 generic.go:356] "Generic (PLEG): container finished" podID="01279335-4077-4099-85cb-ec0ed9925c7b" containerID="2d18d7144057b8e26bdba8d2dd31ea9dcecef5e27541ead67e4a16868a20bc1a" exitCode=0 Oct 30 22:08:03.584003 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:03.583937 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmvbh" event={"ID":"01279335-4077-4099-85cb-ec0ed9925c7b","Type":"ContainerDied","Data":"2d18d7144057b8e26bdba8d2dd31ea9dcecef5e27541ead67e4a16868a20bc1a"} Oct 30 22:08:04.426734 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:04.426700 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:04.426896 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:04.426773 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztkhr" podUID="1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be" Oct 30 22:08:04.426896 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:04.426821 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:04.426896 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:04.426865 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thzg4" podUID="14afa5d3-bd87-4cb2-9c75-9059d4072250" Oct 30 22:08:04.426896 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:04.426892 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:08:04.427018 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:04.426931 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chglk" podUID="aec2e919-1d2a-4605-ba3b-d6f973ef036a" Oct 30 22:08:04.588783 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:04.588752 2564 generic.go:356] "Generic (PLEG): container finished" podID="01279335-4077-4099-85cb-ec0ed9925c7b" containerID="53d7db460f18875097337e862e50f4e0132a81458334d453eb9c57ac11759cfe" exitCode=0 Oct 30 22:08:04.589206 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:04.588791 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmvbh" event={"ID":"01279335-4077-4099-85cb-ec0ed9925c7b","Type":"ContainerDied","Data":"53d7db460f18875097337e862e50f4e0132a81458334d453eb9c57ac11759cfe"} Oct 30 22:08:05.594384 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:05.594335 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" event={"ID":"a9cc4dd2-875f-412d-bf36-880c5f383193","Type":"ContainerStarted","Data":"9765182a104c915234edbcfedd5e2a114075a33da6964827fe6cd1b0d033cc4f"} Oct 30 22:08:05.597355 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:05.597328 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xmvbh" event={"ID":"01279335-4077-4099-85cb-ec0ed9925c7b","Type":"ContainerStarted","Data":"1427207894f8fc31795df233cad7e1e2aa6cedb929c0a134bb5a8d0e9b031a5f"} Oct 30 22:08:05.741881 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:05.741840 2564 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xmvbh" podStartSLOduration=7.827378297 podStartE2EDuration="20.741829278s" totalImagesPullingTime="12.914450981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:05.74155492 +0000 UTC m=+21.770264846" watchObservedRunningTime="2026-10-30 22:08:05.741829278 +0000 UTC m=+21.770539204" Oct 30 22:08:06.426602 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:06.426573 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:08:06.426602 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:06.426593 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:06.426794 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:06.426687 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:06.426794 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:06.426691 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chglk" podUID="aec2e919-1d2a-4605-ba3b-d6f973ef036a" Oct 30 22:08:06.426794 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:06.426778 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thzg4" podUID="14afa5d3-bd87-4cb2-9c75-9059d4072250" Oct 30 22:08:06.426884 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:06.426853 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztkhr" podUID="1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be" Oct 30 22:08:07.604269 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:07.604221 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" event={"ID":"a9cc4dd2-875f-412d-bf36-880c5f383193","Type":"ContainerStarted","Data":"65bd750592eba0b3fd276aa1d8265ad14072a2964feb9564031dd76bdeb5ddd1"} Oct 30 22:08:07.605061 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:07.604470 2564 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:07.605061 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:07.604535 2564 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:07.605061 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:07.604574 2564 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:07.621791 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:07.621770 2564 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:07.621898 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:07.621858 2564 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:07.891488 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:07.891447 2564 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" podStartSLOduration=7.190602567 podStartE2EDuration="22.891435453s" totalImagesPullingTime="15.700832886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:07.891078497 +0000 UTC m=+23.919788426" watchObservedRunningTime="2026-10-30 22:08:07.891435453 +0000 UTC m=+23.920145380" Oct 30 22:08:08.425729 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:08.425702 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:08:08.425729 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:08.425716 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:08.425921 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:08.425818 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chglk" podUID="aec2e919-1d2a-4605-ba3b-d6f973ef036a" Oct 30 22:08:08.425921 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:08.425871 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:08.425992 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:08.425964 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thzg4" podUID="14afa5d3-bd87-4cb2-9c75-9059d4072250" Oct 30 22:08:08.426060 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:08.426041 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztkhr" podUID="1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be" Oct 30 22:08:09.835253 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:09.834978 2564 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ztkhr"] Oct 30 22:08:09.835587 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:09.835261 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:09.835587 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:09.835346 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztkhr" podUID="1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be" Oct 30 22:08:09.838582 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:09.838391 2564 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-chglk"] Oct 30 22:08:09.838582 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:09.838478 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:08:09.838582 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:09.838552 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chglk" podUID="aec2e919-1d2a-4605-ba3b-d6f973ef036a" Oct 30 22:08:09.884256 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:09.884205 2564 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-thzg4"] Oct 30 22:08:09.884365 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:09.884317 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:09.884439 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:09.884415 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thzg4" podUID="14afa5d3-bd87-4cb2-9c75-9059d4072250" Oct 30 22:08:11.425872 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:11.425842 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:08:11.426311 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:11.425897 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:11.426311 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:11.425925 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:11.426311 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:11.426043 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thzg4" podUID="14afa5d3-bd87-4cb2-9c75-9059d4072250" Oct 30 22:08:11.426311 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:11.426070 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztkhr" podUID="1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be" Oct 30 22:08:11.426311 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:11.426131 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chglk" podUID="aec2e919-1d2a-4605-ba3b-d6f973ef036a" Oct 30 22:08:11.760669 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:11.760580 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:12.344895 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:12.344863 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:13.426403 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:13.426370 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:13.426865 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:13.426373 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:13.426865 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:13.426500 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztkhr" podUID="1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be" Oct 30 22:08:13.426865 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:13.426532 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:08:13.426865 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:13.426611 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thzg4" podUID="14afa5d3-bd87-4cb2-9c75-9059d4072250" Oct 30 22:08:13.426865 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:13.426665 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chglk" podUID="aec2e919-1d2a-4605-ba3b-d6f973ef036a" Oct 30 22:08:14.820318 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:14.820285 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:15.134388 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.134345 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:15.256399 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.256377 2564 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeReady" Oct 30 22:08:15.256541 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.256483 2564 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 30 22:08:15.370538 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.370480 2564 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-btmts"] Oct 30 22:08:15.373363 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.373347 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-btmts" Oct 30 22:08:15.407629 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.407610 2564 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hg5cf"] Oct 30 22:08:15.410329 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.410315 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:15.425712 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.425690 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:15.425890 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.425873 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:08:15.426012 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.425999 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:15.426618 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.426597 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 22:08:15.426618 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.426614 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-kpsh7\"" Oct 30 22:08:15.427079 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.427063 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 22:08:15.427118 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.427108 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 22:08:15.447183 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.447161 2564 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-btmts"] Oct 30 22:08:15.484668 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.484646 2564 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hg5cf"] Oct 30 22:08:15.492933 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.492916 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e456cbb1-7bc3-4d01-aea9-2af2c8addf39-cert\") pod \"ingress-canary-btmts\" (UID: \"e456cbb1-7bc3-4d01-aea9-2af2c8addf39\") " pod="openshift-ingress-canary/ingress-canary-btmts" Oct 30 22:08:15.493031 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.492939 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmcxj\" (UniqueName: \"kubernetes.io/projected/84c4be79-ca4e-464e-9bfa-71c48c45b67d-kube-api-access-kmcxj\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:15.493031 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.492959 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfcs4\" (UniqueName: \"kubernetes.io/projected/e456cbb1-7bc3-4d01-aea9-2af2c8addf39-kube-api-access-rfcs4\") pod \"ingress-canary-btmts\" (UID: \"e456cbb1-7bc3-4d01-aea9-2af2c8addf39\") " pod="openshift-ingress-canary/ingress-canary-btmts" Oct 30 22:08:15.493031 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.492976 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/84c4be79-ca4e-464e-9bfa-71c48c45b67d-config-volume\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:15.493190 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.493114 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84c4be79-ca4e-464e-9bfa-71c48c45b67d-tmp-dir\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:15.493263 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.493200 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:15.527115 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.527089 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 22:08:15.527183 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.527111 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 22:08:15.527183 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.527173 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-f5pfp\"" Oct 30 22:08:15.527294 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.527223 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xjxjz\"" Oct 30 22:08:15.527294 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.527261 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qzh2l\"" Oct 30 22:08:15.527294 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.527275 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 22:08:15.527294 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.527283 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-c8f2h\"" Oct 30 22:08:15.528100 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.528085 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 22:08:15.528162 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.528108 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 22:08:15.528162 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.528115 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 22:08:15.594283 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.594258 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/84c4be79-ca4e-464e-9bfa-71c48c45b67d-config-volume\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:15.594389 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.594316 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84c4be79-ca4e-464e-9bfa-71c48c45b67d-tmp-dir\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:15.594446 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.594436 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:15.594499 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.594483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e456cbb1-7bc3-4d01-aea9-2af2c8addf39-cert\") pod \"ingress-canary-btmts\" (UID: \"e456cbb1-7bc3-4d01-aea9-2af2c8addf39\") " pod="openshift-ingress-canary/ingress-canary-btmts" Oct 30 22:08:15.594542 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.594503 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmcxj\" (UniqueName: \"kubernetes.io/projected/84c4be79-ca4e-464e-9bfa-71c48c45b67d-kube-api-access-kmcxj\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:15.594542 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.594534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfcs4\" (UniqueName: \"kubernetes.io/projected/e456cbb1-7bc3-4d01-aea9-2af2c8addf39-kube-api-access-rfcs4\") pod \"ingress-canary-btmts\" (UID: \"e456cbb1-7bc3-4d01-aea9-2af2c8addf39\") " pod="openshift-ingress-canary/ingress-canary-btmts" Oct 30 22:08:15.594632 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:15.594582 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:08:15.594675 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:15.594655 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls podName:84c4be79-ca4e-464e-9bfa-71c48c45b67d nodeName:}" failed. No retries permitted until 2026-10-30 22:08:16.094636176 +0000 UTC m=+32.123346101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls") pod "dns-default-hg5cf" (UID: "84c4be79-ca4e-464e-9bfa-71c48c45b67d") : secret "dns-default-metrics-tls" not found Oct 30 22:08:15.594765 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.594730 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84c4be79-ca4e-464e-9bfa-71c48c45b67d-tmp-dir\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:15.594944 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.594927 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/84c4be79-ca4e-464e-9bfa-71c48c45b67d-config-volume\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:15.598027 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.598006 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e456cbb1-7bc3-4d01-aea9-2af2c8addf39-cert\") pod \"ingress-canary-btmts\" (UID: \"e456cbb1-7bc3-4d01-aea9-2af2c8addf39\") " pod="openshift-ingress-canary/ingress-canary-btmts" Oct 30 22:08:15.656378 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.656347 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfcs4\" (UniqueName: \"kubernetes.io/projected/e456cbb1-7bc3-4d01-aea9-2af2c8addf39-kube-api-access-rfcs4\") pod \"ingress-canary-btmts\" (UID: \"e456cbb1-7bc3-4d01-aea9-2af2c8addf39\") " pod="openshift-ingress-canary/ingress-canary-btmts" Oct 30 22:08:15.656597 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.656578 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmcxj\" (UniqueName: \"kubernetes.io/projected/84c4be79-ca4e-464e-9bfa-71c48c45b67d-kube-api-access-kmcxj\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:15.684918 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.684896 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-btmts" Oct 30 22:08:15.807562 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:15.807526 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:16.065556 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:16.065457 2564 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-btmts"] Oct 30 22:08:16.069874 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:08:16.069844 2564 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode456cbb1_7bc3_4d01_aea9_2af2c8addf39.slice/crio-413f85621879dd946dc2198f4266f35170d19054c7d1ae29bbf8dcd55de768da WatchSource:0}: Error finding container 413f85621879dd946dc2198f4266f35170d19054c7d1ae29bbf8dcd55de768da: Status 404 returned error can't find the container with id 413f85621879dd946dc2198f4266f35170d19054c7d1ae29bbf8dcd55de768da Oct 30 22:08:16.086790 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:16.086760 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:16.097592 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:16.097571 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:16.097699 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:16.097687 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:08:16.097744 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:16.097733 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls podName:84c4be79-ca4e-464e-9bfa-71c48c45b67d nodeName:}" failed. No retries permitted until 2026-10-30 22:08:17.097720877 +0000 UTC m=+33.126430782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls") pod "dns-default-hg5cf" (UID: "84c4be79-ca4e-464e-9bfa-71c48c45b67d") : secret "dns-default-metrics-tls" not found Oct 30 22:08:16.623417 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:16.623389 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-btmts" event={"ID":"e456cbb1-7bc3-4d01-aea9-2af2c8addf39","Type":"ContainerStarted","Data":"413f85621879dd946dc2198f4266f35170d19054c7d1ae29bbf8dcd55de768da"} Oct 30 22:08:17.106257 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:17.106209 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:17.106744 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:17.106373 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:08:17.106744 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:17.106450 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls podName:84c4be79-ca4e-464e-9bfa-71c48c45b67d nodeName:}" failed. No retries permitted until 2026-10-30 22:08:19.106430543 +0000 UTC m=+35.135140448 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls") pod "dns-default-hg5cf" (UID: "84c4be79-ca4e-464e-9bfa-71c48c45b67d") : secret "dns-default-metrics-tls" not found Oct 30 22:08:17.388739 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:17.388695 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:17.736119 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:17.736044 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:18.123679 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.123609 2564 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nf65g"] Oct 30 22:08:18.140451 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.140431 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:18.190416 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.190386 2564 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nf65g"] Oct 30 22:08:18.214202 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.214170 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs\") pod \"network-metrics-daemon-thzg4\" (UID: \"14afa5d3-bd87-4cb2-9c75-9059d4072250\") " pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:18.214352 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.214215 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a56c9584-f976-4ce6-a18a-946c6e24ff21-data-volume\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:18.214352 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.214269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:18.214352 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.214293 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7mkn\" (UniqueName: \"kubernetes.io/projected/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-api-access-m7mkn\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:18.214352 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.214344 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a56c9584-f976-4ce6-a18a-946c6e24ff21-crio-socket\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:18.214504 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:18.214356 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 22:08:18.214504 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:18.214454 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs podName:14afa5d3-bd87-4cb2-9c75-9059d4072250 nodeName:}" failed. No retries permitted until 2026-10-30 22:08:50.214432566 +0000 UTC m=+66.243142485 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs") pod "network-metrics-daemon-thzg4" (UID: "14afa5d3-bd87-4cb2-9c75-9059d4072250") : secret "metrics-daemon-secret" not found Oct 30 22:08:18.214504 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.214480 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:18.239211 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.239182 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 22:08:18.239943 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.239915 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 22:08:18.240221 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.240053 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nff88\"" Oct 30 22:08:18.240221 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.240126 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 22:08:18.240221 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.240173 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 22:08:18.315131 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.315104 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a56c9584-f976-4ce6-a18a-946c6e24ff21-data-volume\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:18.315308 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.315142 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:18.315308 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.315165 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7mkn\" (UniqueName: \"kubernetes.io/projected/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-api-access-m7mkn\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:18.315308 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.315200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a56c9584-f976-4ce6-a18a-946c6e24ff21-crio-socket\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:18.315308 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.315228 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:18.315308 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:18.315267 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 22:08:18.315308 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.315280 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:18.315600 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.315320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8fmp\" (UniqueName: \"kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp\") pod \"network-check-target-chglk\" (UID: \"aec2e919-1d2a-4605-ba3b-d6f973ef036a\") " pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:08:18.315600 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:18.315341 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-rbac-proxy-cm podName:a56c9584-f976-4ce6-a18a-946c6e24ff21 nodeName:}" failed. No retries permitted until 2026-10-30 22:08:18.815321553 +0000 UTC m=+34.844031481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nf65g" (UID: "a56c9584-f976-4ce6-a18a-946c6e24ff21") : configmap "kube-rbac-proxy" not found Oct 30 22:08:18.315600 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.315432 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a56c9584-f976-4ce6-a18a-946c6e24ff21-crio-socket\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:18.315600 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.315493 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a56c9584-f976-4ce6-a18a-946c6e24ff21-data-volume\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:18.315600 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:18.315520 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:08:18.315600 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:18.315551 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls podName:a56c9584-f976-4ce6-a18a-946c6e24ff21 nodeName:}" failed. No retries permitted until 2026-10-30 22:08:18.815543085 +0000 UTC m=+34.844252990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nf65g" (UID: "a56c9584-f976-4ce6-a18a-946c6e24ff21") : secret "insights-runtime-extractor-tls" not found Oct 30 22:08:18.317964 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.317941 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:18.320880 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.320858 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8fmp\" (UniqueName: \"kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp\") pod \"network-check-target-chglk\" (UID: \"aec2e919-1d2a-4605-ba3b-d6f973ef036a\") " pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:08:18.356367 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.356344 2564 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-zgdkz-zxwv9"] Oct 30 22:08:18.380515 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.380490 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7mkn\" (UniqueName: \"kubernetes.io/projected/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-api-access-m7mkn\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:18.385657 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.385641 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:18.418860 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.418794 2564 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-zgdkz-zxwv9"] Oct 30 22:08:18.432084 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.432064 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:18.436667 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.436647 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:18.438752 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.438737 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Oct 30 22:08:18.438833 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.438820 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-h8kpj\"" Oct 30 22:08:18.441316 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.441300 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:08:18.518517 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.517294 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kkxd\" (UniqueName: \"kubernetes.io/projected/d9695030-e34c-40b4-90d1-93cc907cd491-kube-api-access-7kkxd\") pod \"periodic-gathering-zgdkz-zxwv9\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:18.518517 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.517337 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/d9695030-e34c-40b4-90d1-93cc907cd491-archives-path\") pod \"periodic-gathering-zgdkz-zxwv9\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:18.518517 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.517442 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9695030-e34c-40b4-90d1-93cc907cd491-trusted-ca-bundle\") pod \"periodic-gathering-zgdkz-zxwv9\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:18.518517 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.517483 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9695030-e34c-40b4-90d1-93cc907cd491-service-ca-bundle\") pod \"periodic-gathering-zgdkz-zxwv9\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:18.539849 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.539527 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Oct 30 22:08:18.618780 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.618749 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9695030-e34c-40b4-90d1-93cc907cd491-trusted-ca-bundle\") pod \"periodic-gathering-zgdkz-zxwv9\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:18.618941 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.618803 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9695030-e34c-40b4-90d1-93cc907cd491-service-ca-bundle\") pod \"periodic-gathering-zgdkz-zxwv9\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:18.619003 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.618948 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kkxd\" (UniqueName: \"kubernetes.io/projected/d9695030-e34c-40b4-90d1-93cc907cd491-kube-api-access-7kkxd\") pod \"periodic-gathering-zgdkz-zxwv9\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:18.619003 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.618990 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/d9695030-e34c-40b4-90d1-93cc907cd491-archives-path\") pod \"periodic-gathering-zgdkz-zxwv9\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:18.619398 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.619376 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/d9695030-e34c-40b4-90d1-93cc907cd491-archives-path\") pod \"periodic-gathering-zgdkz-zxwv9\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:18.619585 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.619564 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9695030-e34c-40b4-90d1-93cc907cd491-service-ca-bundle\") pod \"periodic-gathering-zgdkz-zxwv9\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:18.619856 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.619839 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9695030-e34c-40b4-90d1-93cc907cd491-trusted-ca-bundle\") pod \"periodic-gathering-zgdkz-zxwv9\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:18.681990 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.681933 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kkxd\" (UniqueName: \"kubernetes.io/projected/d9695030-e34c-40b4-90d1-93cc907cd491-kube-api-access-7kkxd\") pod \"periodic-gathering-zgdkz-zxwv9\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:18.709754 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.709725 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:18.762026 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.761992 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:18.821077 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.821051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:18.821198 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.821120 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:18.821258 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:18.821190 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 22:08:18.821306 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:18.821291 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:08:18.821353 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:18.821298 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-rbac-proxy-cm podName:a56c9584-f976-4ce6-a18a-946c6e24ff21 nodeName:}" failed. No retries permitted until 2026-10-30 22:08:19.821276659 +0000 UTC m=+35.849986583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nf65g" (UID: "a56c9584-f976-4ce6-a18a-946c6e24ff21") : configmap "kube-rbac-proxy" not found Oct 30 22:08:18.821395 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:18.821371 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls podName:a56c9584-f976-4ce6-a18a-946c6e24ff21 nodeName:}" failed. No retries permitted until 2026-10-30 22:08:19.821355399 +0000 UTC m=+35.850065312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nf65g" (UID: "a56c9584-f976-4ce6-a18a-946c6e24ff21") : secret "insights-runtime-extractor-tls" not found Oct 30 22:08:18.838455 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.838430 2564 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ztkhr"] Oct 30 22:08:18.851635 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:08:18.851607 2564 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a5f581d_cc10_4cb5_bba9_0ff5b78fb7be.slice/crio-de780b32259c1d31c2029adacb114440bafef2acd3d774d58a40bc49e98a8e8f WatchSource:0}: Error finding container de780b32259c1d31c2029adacb114440bafef2acd3d774d58a40bc49e98a8e8f: Status 404 returned error can't find the container with id de780b32259c1d31c2029adacb114440bafef2acd3d774d58a40bc49e98a8e8f Oct 30 22:08:18.890897 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:18.890872 2564 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-chglk"] Oct 30 22:08:18.897665 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:08:18.897638 2564 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaec2e919_1d2a_4605_ba3b_d6f973ef036a.slice/crio-2b8bdc3d3e6337bb3774dbf8ef97d75a13d48f3b236bda61837dec44797994d5 WatchSource:0}: Error finding container 2b8bdc3d3e6337bb3774dbf8ef97d75a13d48f3b236bda61837dec44797994d5: Status 404 returned error can't find the container with id 2b8bdc3d3e6337bb3774dbf8ef97d75a13d48f3b236bda61837dec44797994d5 Oct 30 22:08:19.110470 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.110444 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:19.120277 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.120254 2564 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-2rvfp"] Oct 30 22:08:19.123478 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.123461 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:19.123609 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:19.123597 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:08:19.123652 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:19.123644 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls podName:84c4be79-ca4e-464e-9bfa-71c48c45b67d nodeName:}" failed. No retries permitted until 2026-10-30 22:08:23.123633211 +0000 UTC m=+39.152343116 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls") pod "dns-default-hg5cf" (UID: "84c4be79-ca4e-464e-9bfa-71c48c45b67d") : secret "dns-default-metrics-tls" not found Oct 30 22:08:19.131841 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:08:19.131820 2564 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9695030_e34c_40b4_90d1_93cc907cd491.slice/crio-85d23c975f0655f6a4491b5d86268bbe67017647d014dd4a0c2ef16ce4436b61 WatchSource:0}: Error finding container 85d23c975f0655f6a4491b5d86268bbe67017647d014dd4a0c2ef16ce4436b61: Status 404 returned error can't find the container with id 85d23c975f0655f6a4491b5d86268bbe67017647d014dd4a0c2ef16ce4436b61 Oct 30 22:08:19.133527 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.133509 2564 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-zgdkz-zxwv9"] Oct 30 22:08:19.133633 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.133611 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-2rvfp" Oct 30 22:08:19.181959 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.181932 2564 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-2rvfp"] Oct 30 22:08:19.187008 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.186986 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 30 22:08:19.187097 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.187010 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 30 22:08:19.187097 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.187025 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dlplv\"" Oct 30 22:08:19.224443 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.224425 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56mp6\" (UniqueName: \"kubernetes.io/projected/a70a380d-f1e4-4128-bb5c-db16f19662e6-kube-api-access-56mp6\") pod \"migrator-66df5d496b-2rvfp\" (UID: \"a70a380d-f1e4-4128-bb5c-db16f19662e6\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-2rvfp" Oct 30 22:08:19.325567 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.325543 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56mp6\" (UniqueName: \"kubernetes.io/projected/a70a380d-f1e4-4128-bb5c-db16f19662e6-kube-api-access-56mp6\") pod \"migrator-66df5d496b-2rvfp\" (UID: \"a70a380d-f1e4-4128-bb5c-db16f19662e6\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-2rvfp" Oct 30 22:08:19.389983 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.389960 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56mp6\" (UniqueName: \"kubernetes.io/projected/a70a380d-f1e4-4128-bb5c-db16f19662e6-kube-api-access-56mp6\") pod \"migrator-66df5d496b-2rvfp\" (UID: \"a70a380d-f1e4-4128-bb5c-db16f19662e6\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-2rvfp" Oct 30 22:08:19.414627 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.414605 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:19.460271 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.460251 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-2rvfp" Oct 30 22:08:19.632181 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.632148 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" event={"ID":"d9695030-e34c-40b4-90d1-93cc907cd491","Type":"ContainerStarted","Data":"85d23c975f0655f6a4491b5d86268bbe67017647d014dd4a0c2ef16ce4436b61"} Oct 30 22:08:19.633380 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.633353 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-chglk" event={"ID":"aec2e919-1d2a-4605-ba3b-d6f973ef036a","Type":"ContainerStarted","Data":"2b8bdc3d3e6337bb3774dbf8ef97d75a13d48f3b236bda61837dec44797994d5"} Oct 30 22:08:19.634582 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.634538 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ztkhr" event={"ID":"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be","Type":"ContainerStarted","Data":"de780b32259c1d31c2029adacb114440bafef2acd3d774d58a40bc49e98a8e8f"} Oct 30 22:08:19.636020 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.635996 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-btmts" event={"ID":"e456cbb1-7bc3-4d01-aea9-2af2c8addf39","Type":"ContainerStarted","Data":"f744174d768edd88836ebbc71417dcc0716425dab9536ec2c3f226290b33bf16"} Oct 30 22:08:19.661588 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.661561 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:19.753679 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.753638 2564 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-btmts" podStartSLOduration=1.479693723 podStartE2EDuration="4.753627207s" totalImagesPullingTime="3.273933484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:19.753104552 +0000 UTC m=+35.781814503" watchObservedRunningTime="2026-10-30 22:08:19.753627207 +0000 UTC m=+35.782337133" Oct 30 22:08:19.829996 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.829964 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:19.830130 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.830035 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:19.830130 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:19.830106 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 22:08:19.830219 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:19.830124 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:08:19.830219 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:19.830165 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-rbac-proxy-cm podName:a56c9584-f976-4ce6-a18a-946c6e24ff21 nodeName:}" failed. No retries permitted until 2026-10-30 22:08:21.830151736 +0000 UTC m=+37.858861641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nf65g" (UID: "a56c9584-f976-4ce6-a18a-946c6e24ff21") : configmap "kube-rbac-proxy" not found Oct 30 22:08:19.830219 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:19.830179 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls podName:a56c9584-f976-4ce6-a18a-946c6e24ff21 nodeName:}" failed. No retries permitted until 2026-10-30 22:08:21.830172782 +0000 UTC m=+37.858882687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nf65g" (UID: "a56c9584-f976-4ce6-a18a-946c6e24ff21") : secret "insights-runtime-extractor-tls" not found Oct 30 22:08:19.841384 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:19.841128 2564 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-2rvfp"] Oct 30 22:08:19.847090 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:08:19.846551 2564 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda70a380d_f1e4_4128_bb5c_db16f19662e6.slice/crio-d946a87d09e45f22fbf97b99023cc7f7482c0caa10841f3a5f8f5c9515245c9f WatchSource:0}: Error finding container d946a87d09e45f22fbf97b99023cc7f7482c0caa10841f3a5f8f5c9515245c9f: Status 404 returned error can't find the container with id d946a87d09e45f22fbf97b99023cc7f7482c0caa10841f3a5f8f5c9515245c9f Oct 30 22:08:20.642024 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:20.641985 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-2rvfp" event={"ID":"a70a380d-f1e4-4128-bb5c-db16f19662e6","Type":"ContainerStarted","Data":"d946a87d09e45f22fbf97b99023cc7f7482c0caa10841f3a5f8f5c9515245c9f"} Oct 30 22:08:20.661323 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:20.661172 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:20.971853 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:20.971745 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:21.811772 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:21.811741 2564 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-fkhzw"] Oct 30 22:08:21.828259 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:21.828215 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-fkhzw" Oct 30 22:08:21.847451 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:21.847426 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:21.847598 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:21.847495 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:21.847598 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:21.847541 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 22:08:21.847598 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:21.847595 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-rbac-proxy-cm podName:a56c9584-f976-4ce6-a18a-946c6e24ff21 nodeName:}" failed. No retries permitted until 2026-10-30 22:08:25.847580539 +0000 UTC m=+41.876290457 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nf65g" (UID: "a56c9584-f976-4ce6-a18a-946c6e24ff21") : configmap "kube-rbac-proxy" not found Oct 30 22:08:21.847770 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:21.847630 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:08:21.847770 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:21.847672 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls podName:a56c9584-f976-4ce6-a18a-946c6e24ff21 nodeName:}" failed. No retries permitted until 2026-10-30 22:08:25.847658583 +0000 UTC m=+41.876368502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nf65g" (UID: "a56c9584-f976-4ce6-a18a-946c6e24ff21") : secret "insights-runtime-extractor-tls" not found Oct 30 22:08:21.873543 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:21.873515 2564 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-fkhzw"] Oct 30 22:08:21.921922 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:21.921769 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Oct 30 22:08:21.921922 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:21.921813 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Oct 30 22:08:21.921922 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:21.921824 2564 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Oct 30 22:08:21.921922 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:21.921896 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Oct 30 22:08:21.930476 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:21.930123 2564 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jvf6k\"" Oct 30 22:08:21.948004 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:21.947822 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7-signing-cabundle\") pod \"service-ca-5fffc97bdf-fkhzw\" (UID: \"ce692f4a-8f69-4923-bcb4-bb39a7cc5de7\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fkhzw" Oct 30 22:08:21.948004 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:21.947879 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn5dk\" (UniqueName: \"kubernetes.io/projected/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7-kube-api-access-sn5dk\") pod \"service-ca-5fffc97bdf-fkhzw\" (UID: \"ce692f4a-8f69-4923-bcb4-bb39a7cc5de7\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fkhzw" Oct 30 22:08:21.948004 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:21.947898 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7-signing-key\") pod \"service-ca-5fffc97bdf-fkhzw\" (UID: \"ce692f4a-8f69-4923-bcb4-bb39a7cc5de7\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fkhzw" Oct 30 22:08:22.049595 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:22.048180 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn5dk\" (UniqueName: \"kubernetes.io/projected/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7-kube-api-access-sn5dk\") pod \"service-ca-5fffc97bdf-fkhzw\" (UID: \"ce692f4a-8f69-4923-bcb4-bb39a7cc5de7\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fkhzw" Oct 30 22:08:22.049595 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:22.048232 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7-signing-key\") pod \"service-ca-5fffc97bdf-fkhzw\" (UID: \"ce692f4a-8f69-4923-bcb4-bb39a7cc5de7\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fkhzw" Oct 30 22:08:22.049595 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:22.048331 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7-signing-cabundle\") pod \"service-ca-5fffc97bdf-fkhzw\" (UID: \"ce692f4a-8f69-4923-bcb4-bb39a7cc5de7\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fkhzw" Oct 30 22:08:22.049595 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:22.048997 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7-signing-cabundle\") pod \"service-ca-5fffc97bdf-fkhzw\" (UID: \"ce692f4a-8f69-4923-bcb4-bb39a7cc5de7\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fkhzw" Oct 30 22:08:22.051924 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:22.051902 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7-signing-key\") pod \"service-ca-5fffc97bdf-fkhzw\" (UID: \"ce692f4a-8f69-4923-bcb4-bb39a7cc5de7\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fkhzw" Oct 30 22:08:22.114101 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:22.114032 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn5dk\" (UniqueName: \"kubernetes.io/projected/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7-kube-api-access-sn5dk\") pod \"service-ca-5fffc97bdf-fkhzw\" (UID: \"ce692f4a-8f69-4923-bcb4-bb39a7cc5de7\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fkhzw" Oct 30 22:08:22.138249 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:22.138212 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:22.163289 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:22.163083 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-fkhzw" Oct 30 22:08:22.564080 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:22.564054 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:22.575382 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:22.575357 2564 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-fkhzw"] Oct 30 22:08:22.579685 ip-10-0-129-150 kubenswrapper[2564]: W1030 22:08:22.579497 2564 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce692f4a_8f69_4923_bcb4_bb39a7cc5de7.slice/crio-edb4720170ec724a91b8559b0d69fe16af188e65aad94fc775b252281c783677 WatchSource:0}: Error finding container edb4720170ec724a91b8559b0d69fe16af188e65aad94fc775b252281c783677: Status 404 returned error can't find the container with id edb4720170ec724a91b8559b0d69fe16af188e65aad94fc775b252281c783677 Oct 30 22:08:22.662397 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:22.662360 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-2rvfp" event={"ID":"a70a380d-f1e4-4128-bb5c-db16f19662e6","Type":"ContainerStarted","Data":"c4cb185143eb7efe761a33e139a59aa21e6ea8aeccbd9bbac983a901131c9025"} Oct 30 22:08:22.664972 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:22.664939 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-fkhzw" event={"ID":"ce692f4a-8f69-4923-bcb4-bb39a7cc5de7","Type":"ContainerStarted","Data":"edb4720170ec724a91b8559b0d69fe16af188e65aad94fc775b252281c783677"} Oct 30 22:08:22.778975 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:22.778917 2564 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-2rvfp" podStartSLOduration=1.473019915 podStartE2EDuration="3.77889947s" totalImagesPullingTime="2.305879555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:22.777900476 +0000 UTC m=+38.806610422" watchObservedRunningTime="2026-10-30 22:08:22.77889947 +0000 UTC m=+38.807609398" Oct 30 22:08:22.882551 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:22.882516 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:23.157744 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:23.157665 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:23.157886 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:23.157830 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:08:23.157934 ip-10-0-129-150 kubenswrapper[2564]: E1030 22:08:23.157904 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls podName:84c4be79-ca4e-464e-9bfa-71c48c45b67d nodeName:}" failed. No retries permitted until 2026-10-30 22:08:31.157884515 +0000 UTC m=+47.186594443 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls") pod "dns-default-hg5cf" (UID: "84c4be79-ca4e-464e-9bfa-71c48c45b67d") : secret "dns-default-metrics-tls" not found Oct 30 22:08:23.173906 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:23.173874 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:23.671418 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:23.671315 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" event={"ID":"d9695030-e34c-40b4-90d1-93cc907cd491","Type":"ContainerStarted","Data":"1c2af0f6cc749191d7a80d0c87de69cc1738ab97682b18ca0ac21f31dc75b0d9"} Oct 30 22:08:23.673750 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:23.673713 2564 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-chglk" event={"ID":"aec2e919-1d2a-4605-ba3b-d6f973ef036a","Type":"ContainerStarted","Data":"929093911baa7365e81104e6693f3bd1423726b5a0d3286bcb13df4040fbe687"} Oct 30 22:08:23.673913 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:23.673890 2564 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:08:23.809943 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:23.809887 2564 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" podStartSLOduration=2.377530962 podStartE2EDuration="5.809874135s" totalImagesPullingTime="3.432343173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:23.809408677 +0000 UTC m=+39.838118597" watchObservedRunningTime="2026-10-30 22:08:23.809874135 +0000 UTC m=+39.838584080" Oct 30 22:08:23.927346 ip-10-0-129-150 kubenswrapper[2564]: I1030 22:08:23.927230 2564 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-chglk" podStartSLOduration=34.458621747 podStartE2EDuration="38.927210231s" totalImagesPullingTime="4.468588484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:23.926034075 +0000 UTC m=+39.954744020" watchObservedRunningTime="2026-10-30 22:08:23.927210231 +0000 UTC m=+39.955920161" Oct 30 22:08:25.314086 ip-10-0-129-150 systemd[1]: Stopping Kubernetes Kubelet... Oct 30 22:08:25.322689 ip-10-0-129-150 systemd[1]: kubelet.service: Deactivated successfully. Oct 30 22:08:25.322901 ip-10-0-129-150 systemd[1]: Stopped Kubernetes Kubelet. Oct 30 22:08:25.322962 ip-10-0-129-150 systemd[1]: kubelet.service: Consumed 2.372s CPU time. Oct 30 22:08:25.330892 ip-10-0-129-150 systemd[1]: Starting Kubernetes Kubelet... Oct 30 22:08:25.433989 ip-10-0-129-150 kubenswrapper[4497]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 22:08:25.433989 ip-10-0-129-150 kubenswrapper[4497]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 22:08:25.433989 ip-10-0-129-150 kubenswrapper[4497]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 22:08:25.433989 ip-10-0-129-150 kubenswrapper[4497]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 22:08:25.438470 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438349 4497 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:08:25.438470 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438456 4497 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:08:25.438470 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438465 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:08:25.438470 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438471 4497 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:08:25.438470 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438475 4497 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:08:25.438470 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438480 4497 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:08:25.438845 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438485 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:08:25.438845 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438489 4497 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:08:25.438845 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438500 4497 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:08:25.438845 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438504 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:08:25.438845 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438508 4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:08:25.438845 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438512 4497 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:08:25.438845 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438515 4497 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:08:25.438845 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438519 4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:08:25.438845 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438523 4497 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:08:25.438845 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438527 4497 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:08:25.438845 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438530 4497 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:08:25.438845 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438534 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:08:25.438845 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438538 4497 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:08:25.438845 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438542 4497 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:08:25.438845 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438545 4497 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:08:25.438845 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438549 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:08:25.438845 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438553 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:08:25.438845 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438556 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:08:25.438845 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438560 4497 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:08:25.438845 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438564 4497 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:08:25.439744 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438576 4497 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:08:25.439744 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438580 4497 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:08:25.439744 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438584 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:08:25.439744 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438587 4497 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:08:25.439744 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438592 4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:08:25.439744 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438596 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:08:25.439744 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438600 4497 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:08:25.439744 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438611 4497 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:08:25.439744 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438615 4497 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:08:25.439744 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438620 4497 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:08:25.439744 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438624 4497 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:08:25.439744 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438629 4497 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:08:25.439744 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438633 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:08:25.439744 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438638 4497 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:08:25.439744 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438643 4497 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:08:25.439744 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438647 4497 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:08:25.439744 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438651 4497 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:08:25.439744 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438656 4497 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:08:25.439744 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438660 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:08:25.440623 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438665 4497 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:08:25.440623 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438669 4497 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:08:25.440623 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438673 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:08:25.440623 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438677 4497 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:08:25.440623 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438681 4497 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:08:25.440623 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438713 4497 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:08:25.440623 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438719 4497 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:08:25.440623 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438725 4497 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:08:25.440623 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438730 4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:08:25.440623 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438734 4497 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:08:25.440623 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438739 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:08:25.440623 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438743 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:08:25.440623 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438747 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:08:25.440623 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438752 4497 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:08:25.440623 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438756 4497 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:08:25.440623 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438760 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:08:25.440623 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438765 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:08:25.440623 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438768 4497 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:08:25.440623 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438774 4497 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:08:25.440623 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438778 4497 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:08:25.441526 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438782 4497 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:08:25.441526 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438786 4497 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:08:25.441526 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438793 4497 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:08:25.441526 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438800 4497 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:08:25.441526 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438804 4497 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:08:25.441526 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438808 4497 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:08:25.441526 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438813 4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:08:25.441526 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438825 4497 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:08:25.441526 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438830 4497 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:08:25.441526 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438835 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:08:25.441526 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438839 4497 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:08:25.441526 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438843 4497 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:08:25.441526 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438847 4497 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:08:25.441526 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438851 4497 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:08:25.441526 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438855 4497 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:08:25.441526 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438860 4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:08:25.441526 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438864 4497 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:08:25.441526 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438868 4497 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:08:25.441526 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438872 4497 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:08:25.441526 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438877 4497 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:08:25.442441 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438881 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:08:25.442441 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438885 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:08:25.442441 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438889 4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:08:25.442441 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438893 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:08:25.442441 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438897 4497 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:08:25.442441 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438902 4497 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:08:25.442441 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438906 4497 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:08:25.442441 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438910 4497 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:08:25.442441 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438915 4497 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:08:25.442441 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438919 4497 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:08:25.442441 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438923 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:08:25.442441 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438927 4497 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:08:25.442441 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438931 4497 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:08:25.442441 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438936 4497 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:08:25.442441 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438940 4497 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:08:25.442441 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438945 4497 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:08:25.442441 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438949 4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:08:25.442441 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438953 4497 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:08:25.442441 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438958 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:08:25.443304 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438962 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:08:25.443304 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.438979 4497 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:08:25.443304 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440332 4497 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:08:25.443304 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440342 4497 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:08:25.443304 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440347 4497 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:08:25.443304 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440351 4497 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:08:25.443304 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440355 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:08:25.443304 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440361 4497 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:08:25.443304 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440366 4497 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:08:25.443304 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440370 4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:08:25.443304 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440374 4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:08:25.443304 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440378 4497 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:08:25.443304 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440383 4497 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:08:25.443304 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440387 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:08:25.443304 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440392 4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:08:25.443304 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440396 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:08:25.443304 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440400 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:08:25.443304 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440404 4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:08:25.443304 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440412 4497 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:08:25.444209 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440416 4497 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:08:25.444209 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440421 4497 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:08:25.444209 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440425 4497 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:08:25.444209 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440429 4497 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:08:25.444209 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440433 4497 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:08:25.444209 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440437 4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:08:25.444209 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440441 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:08:25.444209 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440446 4497 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:08:25.444209 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440450 4497 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:08:25.444209 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440454 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:08:25.444209 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440459 4497 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:08:25.444209 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440463 4497 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:08:25.444209 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440468 4497 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:08:25.444209 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440472 4497 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:08:25.444209 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440476 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:08:25.444209 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440481 4497 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:08:25.444209 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440486 4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:08:25.444209 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440491 4497 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:08:25.444209 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440498 4497 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:08:25.444209 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440505 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:08:25.445120 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440510 4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:08:25.445120 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440515 4497 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:08:25.445120 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440519 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:08:25.445120 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440523 4497 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:08:25.445120 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440527 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:08:25.445120 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440531 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:08:25.445120 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440535 4497 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:08:25.445120 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440540 4497 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:08:25.445120 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440544 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:08:25.445120 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440548 4497 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:08:25.445120 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440552 4497 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:08:25.445120 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440560 4497 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:08:25.445120 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440564 4497 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:08:25.445120 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440569 4497 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:08:25.445120 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440573 4497 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:08:25.445120 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440577 4497 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:08:25.445120 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440581 4497 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:08:25.445120 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440585 4497 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:08:25.445120 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440590 4497 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:08:25.445802 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440594 4497 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:08:25.445802 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440599 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:08:25.445802 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440603 4497 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:08:25.445802 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440608 4497 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:08:25.445802 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440612 4497 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:08:25.445802 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440616 4497 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:08:25.445802 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440619 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:08:25.445802 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440623 4497 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:08:25.445802 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440627 4497 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:08:25.445802 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440632 4497 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:08:25.445802 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440635 4497 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:08:25.445802 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440639 4497 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:08:25.445802 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440643 4497 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:08:25.445802 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440647 4497 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:08:25.445802 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440651 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:08:25.445802 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440655 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:08:25.445802 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440660 4497 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:08:25.445802 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440664 4497 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:08:25.445802 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440668 4497 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:08:25.445802 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440673 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:08:25.446614 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440677 4497 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:08:25.446614 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440681 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:08:25.446614 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440685 4497 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:08:25.446614 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440689 4497 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:08:25.446614 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440694 4497 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:08:25.446614 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440698 4497 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:08:25.446614 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440703 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:08:25.446614 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440707 4497 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:08:25.446614 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440711 4497 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:08:25.446614 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440715 4497 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:08:25.446614 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440719 4497 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:08:25.446614 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440743 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:08:25.446614 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440749 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:08:25.446614 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440753 4497 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:08:25.446614 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440757 4497 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:08:25.446614 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440761 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:08:25.446614 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440780 4497 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:08:25.446614 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440785 4497 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:08:25.446614 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440789 4497 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:08:25.447309 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440793 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:08:25.447309 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440797 4497 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:08:25.447309 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440802 4497 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:08:25.447309 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440806 4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:08:25.447309 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440810 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:08:25.447309 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440814 4497 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:08:25.447309 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440820 4497 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:08:25.447309 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440827 4497 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:08:25.447309 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440835 4497 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:08:25.447309 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440840 4497 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:08:25.447309 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.440845 4497 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:08:25.447309 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441684 4497 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:08:25.447309 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441693 4497 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:08:25.447309 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441697 4497 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:08:25.447309 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441703 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:08:25.447309 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441707 4497 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:08:25.447309 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441712 4497 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:08:25.447309 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441716 4497 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:08:25.447309 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441720 4497 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:08:25.447953 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441725 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:08:25.447953 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441729 4497 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:08:25.447953 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441733 4497 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:08:25.447953 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441739 4497 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:08:25.447953 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441743 4497 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:08:25.447953 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441747 4497 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:08:25.447953 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441752 4497 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:08:25.447953 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441756 4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:08:25.447953 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441761 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:08:25.447953 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441765 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:08:25.447953 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441769 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:08:25.447953 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441773 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:08:25.447953 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441777 4497 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:08:25.447953 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441781 4497 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:08:25.447953 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441786 4497 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:08:25.447953 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441790 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:08:25.447953 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441795 4497 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:08:25.447953 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441800 4497 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:08:25.447953 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441805 4497 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:08:25.447953 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441809 4497 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:08:25.448620 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441813 4497 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:08:25.448620 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441817 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:08:25.448620 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441822 4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:08:25.448620 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441826 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:08:25.448620 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441831 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:08:25.448620 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441835 4497 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:08:25.448620 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441839 4497 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:08:25.448620 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441844 4497 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:08:25.448620 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441850 4497 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:08:25.448620 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441855 4497 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:08:25.448620 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441859 4497 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:08:25.448620 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441863 4497 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:08:25.448620 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441868 4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:08:25.448620 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441872 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:08:25.448620 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441876 4497 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:08:25.448620 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441881 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:08:25.448620 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441885 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:08:25.448620 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441889 4497 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:08:25.448620 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441893 4497 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:08:25.449438 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441897 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:08:25.449438 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441901 4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:08:25.449438 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441906 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:08:25.449438 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441911 4497 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:08:25.449438 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441915 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:08:25.449438 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441919 4497 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:08:25.449438 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441923 4497 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:08:25.449438 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441927 4497 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:08:25.449438 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441931 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:08:25.449438 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441935 4497 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:08:25.449438 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441948 4497 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:08:25.449438 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441955 4497 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:08:25.449438 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441959 4497 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:08:25.449438 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441963 4497 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:08:25.449438 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441968 4497 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:08:25.449438 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441972 4497 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:08:25.449438 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441976 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:08:25.449438 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441980 4497 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:08:25.449438 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441984 4497 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:08:25.450228 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441988 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:08:25.450228 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441993 4497 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:08:25.450228 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.441997 4497 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:08:25.450228 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442002 4497 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:08:25.450228 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442006 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:08:25.450228 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442010 4497 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:08:25.450228 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442014 4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:08:25.450228 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442018 4497 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:08:25.450228 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442023 4497 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:08:25.450228 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442026 4497 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:08:25.450228 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442030 4497 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:08:25.450228 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442034 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:08:25.450228 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442039 4497 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:08:25.450228 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442043 4497 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:08:25.450228 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442047 4497 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:08:25.450228 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442051 4497 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:08:25.450228 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442058 4497 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:08:25.450228 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442067 4497 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:08:25.450228 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442073 4497 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:08:25.450228 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442077 4497 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:08:25.451036 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442082 4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:08:25.451036 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442087 4497 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:08:25.451036 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442091 4497 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:08:25.451036 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442096 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:08:25.451036 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442101 4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:08:25.451036 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442105 4497 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:08:25.451036 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442109 4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:08:25.451036 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442113 4497 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:08:25.451036 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442117 4497 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:08:25.451036 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442121 4497 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:08:25.451036 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442125 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:08:25.451036 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442129 4497 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:08:25.451036 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442133 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:08:25.451036 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442137 4497 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:08:25.451036 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442143 4497 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:08:25.451036 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442147 4497 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:08:25.451036 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442151 4497 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:08:25.451036 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442155 4497 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:08:25.451036 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442159 4497 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:08:25.451036 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.442163 4497 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442325 4497 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442342 4497 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442351 4497 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442358 4497 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442365 4497 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442378 4497 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442385 4497 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442391 4497 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442396 4497 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442403 4497 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442409 4497 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442415 4497 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442420 4497 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442425 4497 flags.go:64] FLAG: --cgroup-root="" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442431 4497 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442436 4497 flags.go:64] FLAG: --client-ca-file="" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442440 4497 flags.go:64] FLAG: --cloud-provider="external" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442446 4497 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442452 4497 flags.go:64] FLAG: --cluster-domain="" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442456 4497 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442461 4497 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442466 4497 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442472 4497 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 22:08:25.451799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442478 4497 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442483 4497 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442488 4497 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442493 4497 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442497 4497 flags.go:64] FLAG: --contention-profiling="false" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442502 4497 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442507 4497 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442512 4497 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442516 4497 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442524 4497 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442529 4497 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442533 4497 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442538 4497 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442543 4497 flags.go:64] FLAG: --enable-server="true" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442548 4497 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442554 4497 flags.go:64] FLAG: --event-burst="100" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442558 4497 flags.go:64] FLAG: --event-qps="50" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442563 4497 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442569 4497 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442574 4497 flags.go:64] FLAG: --eviction-hard="" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442581 4497 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442585 4497 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442590 4497 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442597 4497 flags.go:64] FLAG: --eviction-soft="" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442602 4497 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 22:08:25.452973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442607 4497 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442612 4497 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442617 4497 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442622 4497 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442627 4497 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442631 4497 flags.go:64] FLAG: --feature-gates="" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442637 4497 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442643 4497 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442648 4497 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442652 4497 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442657 4497 flags.go:64] FLAG: --healthz-port="10248" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442662 4497 flags.go:64] FLAG: --help="false" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442667 4497 flags.go:64] FLAG: --hostname-override="ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442672 4497 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442677 4497 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442681 4497 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442687 4497 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442692 4497 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442697 4497 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442702 4497 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442706 4497 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442712 4497 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442717 4497 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 22:08:25.453996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442722 4497 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442726 4497 flags.go:64] FLAG: --kube-reserved="" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442733 4497 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442737 4497 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442742 4497 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442747 4497 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442751 4497 flags.go:64] FLAG: --lock-file="" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442758 4497 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442762 4497 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442767 4497 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442776 4497 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442781 4497 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442787 4497 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442792 4497 flags.go:64] FLAG: --logging-format="text" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442797 4497 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442802 4497 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442807 4497 flags.go:64] FLAG: --manifest-url="" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442811 4497 flags.go:64] FLAG: --manifest-url-header="" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442818 4497 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442823 4497 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442830 4497 flags.go:64] FLAG: --max-pods="110" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442834 4497 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442839 4497 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442844 4497 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442848 4497 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 22:08:25.454863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442853 4497 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442858 4497 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442863 4497 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442875 4497 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442880 4497 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442884 4497 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442889 4497 flags.go:64] FLAG: --pod-cidr="" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442894 4497 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442898 4497 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442905 4497 flags.go:64] FLAG: --pods-per-core="0" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442910 4497 flags.go:64] FLAG: --port="10250" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442915 4497 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442919 4497 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0e5164a540c745e00" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442925 4497 flags.go:64] FLAG: --qos-reserved="" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442931 4497 flags.go:64] FLAG: --read-only-port="10255" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442935 4497 flags.go:64] FLAG: --register-node="true" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442940 4497 flags.go:64] FLAG: --register-with-taints="" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442946 4497 flags.go:64] FLAG: --registry-burst="10" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442951 4497 flags.go:64] FLAG: --registry-qps="5" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442956 4497 flags.go:64] FLAG: --reserved-cpus="" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442961 4497 flags.go:64] FLAG: --reserved-memory="" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442967 4497 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442972 4497 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442977 4497 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442981 4497 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442986 4497 flags.go:64] FLAG: --runonce="false" Oct 30 22:08:25.455892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442990 4497 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.442995 4497 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443000 4497 flags.go:64] FLAG: --seccomp-default="false" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443005 4497 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443010 4497 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443015 4497 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443019 4497 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443024 4497 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443029 4497 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443034 4497 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443038 4497 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443043 4497 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443048 4497 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443053 4497 flags.go:64] FLAG: --system-cgroups="" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443057 4497 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443067 4497 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443072 4497 flags.go:64] FLAG: --tls-cert-file="" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443077 4497 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443083 4497 flags.go:64] FLAG: --tls-min-version="" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443088 4497 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443094 4497 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443099 4497 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443103 4497 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443108 4497 flags.go:64] FLAG: --v="2" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443114 4497 flags.go:64] FLAG: --version="false" Oct 30 22:08:25.456854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443121 4497 flags.go:64] FLAG: --vmodule="" Oct 30 22:08:25.457858 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443127 4497 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 22:08:25.457858 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443134 4497 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 22:08:25.457858 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443382 4497 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:08:25.457858 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443392 4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:08:25.457858 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443397 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:08:25.457858 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443401 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:08:25.457858 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443407 4497 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:08:25.457858 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443414 4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:08:25.457858 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443418 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:08:25.457858 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443423 4497 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:08:25.457858 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443428 4497 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:08:25.457858 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443432 4497 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:08:25.457858 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443437 4497 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:08:25.457858 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443441 4497 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:08:25.457858 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443445 4497 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:08:25.457858 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443450 4497 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:08:25.457858 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443454 4497 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:08:25.457858 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443458 4497 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:08:25.457858 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443463 4497 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:08:25.458617 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443467 4497 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:08:25.458617 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443471 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:08:25.458617 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443478 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:08:25.458617 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443482 4497 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:08:25.458617 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443486 4497 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:08:25.458617 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443491 4497 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:08:25.458617 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443495 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:08:25.458617 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443501 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:08:25.458617 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443506 4497 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:08:25.458617 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443510 4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:08:25.458617 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443515 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:08:25.458617 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443519 4497 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:08:25.458617 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443523 4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:08:25.458617 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443528 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:08:25.458617 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443532 4497 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:08:25.458617 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443537 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:08:25.458617 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443541 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:08:25.458617 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443546 4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:08:25.458617 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443550 4497 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:08:25.459301 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443555 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:08:25.459301 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443560 4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:08:25.459301 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443563 4497 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:08:25.459301 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443567 4497 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:08:25.459301 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443572 4497 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:08:25.459301 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443576 4497 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:08:25.459301 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443581 4497 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:08:25.459301 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443585 4497 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:08:25.459301 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443589 4497 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:08:25.459301 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443594 4497 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:08:25.459301 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443598 4497 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:08:25.459301 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443605 4497 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:08:25.459301 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443609 4497 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:08:25.459301 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443613 4497 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:08:25.459301 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443618 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:08:25.459301 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443623 4497 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:08:25.459301 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443628 4497 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:08:25.459301 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443632 4497 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:08:25.459301 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443637 4497 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:08:25.459301 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443641 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:08:25.460075 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443647 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:08:25.460075 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443651 4497 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:08:25.460075 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443656 4497 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:08:25.460075 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443660 4497 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:08:25.460075 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443665 4497 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:08:25.460075 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443669 4497 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:08:25.460075 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443673 4497 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:08:25.460075 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443677 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:08:25.460075 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443681 4497 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:08:25.460075 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443686 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:08:25.460075 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443691 4497 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:08:25.460075 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443696 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:08:25.460075 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443700 4497 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:08:25.460075 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443704 4497 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:08:25.460075 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443708 4497 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:08:25.460075 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443715 4497 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:08:25.460075 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443722 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:08:25.460075 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443727 4497 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:08:25.460075 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443732 4497 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:08:25.460791 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443738 4497 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:08:25.460791 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443742 4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:08:25.460791 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443747 4497 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:08:25.460791 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443751 4497 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:08:25.460791 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443755 4497 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:08:25.460791 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443759 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:08:25.460791 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443763 4497 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:08:25.460791 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443767 4497 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:08:25.460791 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443774 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:08:25.460791 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443778 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:08:25.460791 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443782 4497 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:08:25.460791 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443787 4497 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:08:25.460791 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443791 4497 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:08:25.460791 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443797 4497 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:08:25.460791 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443801 4497 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:08:25.460791 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443805 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:08:25.460791 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443809 4497 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:08:25.460791 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443813 4497 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:08:25.460791 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443818 4497 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:08:25.461528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443822 4497 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:08:25.461528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443826 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:08:25.461528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443830 4497 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:08:25.461528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443834 4497 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:08:25.461528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443847 4497 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:08:25.461528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443851 4497 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:08:25.461528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443855 4497 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:08:25.461528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443859 4497 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:08:25.461528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443864 4497 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:08:25.461528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443868 4497 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:08:25.461528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443897 4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:08:25.461528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.443902 4497 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:08:25.461528 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.443948 4497 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 22:08:25.461528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444003 4497 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:08:25.461528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444011 4497 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:08:25.461528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444016 4497 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:08:25.462029 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444021 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:08:25.462029 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444026 4497 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:08:25.462029 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444030 4497 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:08:25.462029 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444034 4497 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:08:25.462029 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444038 4497 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:08:25.462029 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444042 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:08:25.462029 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444048 4497 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:08:25.462029 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444053 4497 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:08:25.462029 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444057 4497 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:08:25.462029 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444061 4497 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:08:25.462029 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444067 4497 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:08:25.462029 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444071 4497 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:08:25.462029 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444076 4497 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:08:25.462029 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444081 4497 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:08:25.462029 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444085 4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:08:25.462029 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444090 4497 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:08:25.462029 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444093 4497 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:08:25.462029 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444098 4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:08:25.462029 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444102 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:08:25.462029 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444106 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:08:25.462830 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444112 4497 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:08:25.462830 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444127 4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:08:25.462830 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444132 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:08:25.462830 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444137 4497 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:08:25.462830 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444141 4497 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:08:25.462830 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444147 4497 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:08:25.462830 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444151 4497 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:08:25.462830 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444157 4497 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:08:25.462830 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444161 4497 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:08:25.462830 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444166 4497 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:08:25.462830 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444170 4497 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:08:25.462830 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444174 4497 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:08:25.462830 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444179 4497 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:08:25.462830 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444183 4497 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:08:25.462830 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444187 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:08:25.462830 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444191 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:08:25.462830 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444195 4497 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:08:25.462830 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444200 4497 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:08:25.462830 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444205 4497 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:08:25.463476 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444209 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:08:25.463476 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444213 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:08:25.463476 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444217 4497 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:08:25.463476 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444221 4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:08:25.463476 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444225 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:08:25.463476 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444229 4497 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:08:25.463476 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444267 4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:08:25.463476 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444272 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:08:25.463476 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444276 4497 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:08:25.463476 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444280 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:08:25.463476 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444284 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:08:25.463476 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444289 4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:08:25.463476 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444292 4497 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:08:25.463476 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444297 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:08:25.463476 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444304 4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:08:25.463476 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444316 4497 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:08:25.463476 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444320 4497 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:08:25.463476 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444325 4497 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:08:25.463476 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444329 4497 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:08:25.463476 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444333 4497 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:08:25.464292 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444338 4497 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:08:25.464292 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444342 4497 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:08:25.464292 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444346 4497 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:08:25.464292 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444350 4497 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:08:25.464292 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444355 4497 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:08:25.464292 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444359 4497 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:08:25.464292 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444364 4497 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:08:25.464292 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444368 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:08:25.464292 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444372 4497 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:08:25.464292 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444376 4497 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:08:25.464292 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444400 4497 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:08:25.464292 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444407 4497 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:08:25.464292 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444411 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:08:25.464292 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444416 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:08:25.464292 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444420 4497 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:08:25.464292 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444424 4497 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:08:25.464292 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444429 4497 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:08:25.464292 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444433 4497 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:08:25.464292 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444437 4497 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:08:25.464292 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444441 4497 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:08:25.464968 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444445 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:08:25.464968 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444469 4497 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:08:25.464968 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444475 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:08:25.464968 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444479 4497 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:08:25.464968 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444484 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:08:25.464968 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444488 4497 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:08:25.464968 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444492 4497 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:08:25.464968 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444496 4497 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:08:25.464968 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444512 4497 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:08:25.464968 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444519 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:08:25.464968 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444523 4497 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:08:25.464968 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444528 4497 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:08:25.464968 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444533 4497 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:08:25.464968 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444537 4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:08:25.464968 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444542 4497 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:08:25.464968 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444547 4497 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:08:25.464968 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444551 4497 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:08:25.464968 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444555 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:08:25.464968 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444560 4497 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:08:25.465583 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444564 4497 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:08:25.465583 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444569 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:08:25.465583 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444573 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:08:25.465583 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444577 4497 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:08:25.465583 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.444583 4497 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:08:25.465583 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.451947 4497 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 22:08:25.465583 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.451966 4497 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 22:08:25.465583 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.451987 4497 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 22:08:25.465583 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.451995 4497 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 22:08:25.465583 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452073 4497 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:08:25.465583 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452080 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:08:25.465583 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452086 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:08:25.465583 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452093 4497 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:08:25.465583 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452098 4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:08:25.465583 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452103 4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:08:25.465583 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452108 4497 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:08:25.465583 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452112 4497 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:08:25.465583 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452115 4497 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:08:25.466194 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452118 4497 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:08:25.466194 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452121 4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:08:25.466194 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452124 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:08:25.466194 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452126 4497 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:08:25.466194 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452129 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:08:25.466194 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452131 4497 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:08:25.466194 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452136 4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:08:25.466194 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452140 4497 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:08:25.466194 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452145 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:08:25.466194 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452150 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:08:25.466194 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452156 4497 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:08:25.466194 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452164 4497 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:08:25.466194 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452170 4497 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:08:25.466194 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452174 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:08:25.466194 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452177 4497 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:08:25.466194 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452180 4497 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:08:25.466194 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452183 4497 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:08:25.466194 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452185 4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:08:25.466194 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452188 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:08:25.467064 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452190 4497 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:08:25.467064 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452193 4497 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:08:25.467064 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452195 4497 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:08:25.467064 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452198 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:08:25.467064 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452200 4497 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:08:25.467064 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452204 4497 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:08:25.467064 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452209 4497 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:08:25.467064 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452213 4497 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:08:25.467064 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452217 4497 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:08:25.467064 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452222 4497 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:08:25.467064 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452227 4497 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:08:25.467064 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452231 4497 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:08:25.467064 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452260 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:08:25.467064 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452265 4497 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:08:25.467064 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452270 4497 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:08:25.467064 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452274 4497 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:08:25.467064 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452278 4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:08:25.467064 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452284 4497 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:08:25.467064 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452288 4497 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:08:25.467064 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452294 4497 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:08:25.467812 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452299 4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:08:25.467812 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452304 4497 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:08:25.467812 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452309 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:08:25.467812 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452313 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:08:25.467812 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452318 4497 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:08:25.467812 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452322 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:08:25.467812 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452327 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:08:25.467812 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452332 4497 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:08:25.467812 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452336 4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:08:25.467812 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452341 4497 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:08:25.467812 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452346 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:08:25.467812 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452351 4497 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:08:25.467812 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452355 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:08:25.467812 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452360 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:08:25.467812 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452365 4497 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:08:25.467812 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452370 4497 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:08:25.467812 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452375 4497 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:08:25.467812 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452379 4497 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:08:25.467812 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452384 4497 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:08:25.468515 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452386 4497 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:08:25.468515 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452389 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:08:25.468515 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452392 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:08:25.468515 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452396 4497 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:08:25.468515 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452400 4497 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:08:25.468515 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452404 4497 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:08:25.468515 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452408 4497 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:08:25.468515 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452414 4497 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:08:25.468515 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452419 4497 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:08:25.468515 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452425 4497 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:08:25.468515 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452430 4497 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:08:25.468515 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452435 4497 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:08:25.468515 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452441 4497 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:08:25.468515 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452445 4497 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:08:25.468515 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452448 4497 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:08:25.468515 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452451 4497 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:08:25.468515 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452453 4497 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:08:25.468515 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452457 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:08:25.468515 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452461 4497 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:08:25.469153 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452465 4497 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:08:25.469153 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452468 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:08:25.469153 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452473 4497 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:08:25.469153 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452476 4497 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:08:25.469153 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452480 4497 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:08:25.469153 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452485 4497 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:08:25.469153 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452489 4497 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:08:25.469153 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452493 4497 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:08:25.469153 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452496 4497 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:08:25.469153 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452498 4497 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:08:25.469153 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452501 4497 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:08:25.469153 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452504 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:08:25.469153 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452507 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:08:25.469153 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452509 4497 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:08:25.469153 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452512 4497 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:08:25.469153 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452514 4497 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:08:25.469153 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452517 4497 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:08:25.469153 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452521 4497 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:08:25.469153 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452525 4497 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:08:25.469153 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452529 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:08:25.469897 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.452572 4497 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 22:08:25.469897 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452778 4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:08:25.469897 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452785 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:08:25.469897 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452788 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:08:25.469897 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452791 4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:08:25.469897 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452794 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:08:25.469897 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452797 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:08:25.469897 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452802 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:08:25.469897 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452807 4497 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:08:25.469897 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452810 4497 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:08:25.469897 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452813 4497 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:08:25.469897 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452817 4497 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:08:25.469897 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452822 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:08:25.469897 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452826 4497 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:08:25.469897 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452830 4497 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:08:25.469897 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452834 4497 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:08:25.470506 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452837 4497 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:08:25.470506 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452840 4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:08:25.470506 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452844 4497 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:08:25.470506 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452849 4497 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:08:25.470506 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452852 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:08:25.470506 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452855 4497 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:08:25.470506 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452858 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:08:25.470506 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452861 4497 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:08:25.470506 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452865 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:08:25.470506 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452870 4497 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:08:25.470506 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452875 4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:08:25.470506 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452879 4497 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:08:25.470506 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452883 4497 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:08:25.470506 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452887 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:08:25.470506 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452892 4497 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:08:25.470506 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452898 4497 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:08:25.470506 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452906 4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:08:25.470506 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452912 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:08:25.470506 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452916 4497 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:08:25.471216 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452921 4497 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:08:25.471216 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452925 4497 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:08:25.471216 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452930 4497 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:08:25.471216 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452935 4497 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:08:25.471216 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452940 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:08:25.471216 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452944 4497 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:08:25.471216 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452947 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:08:25.471216 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452950 4497 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:08:25.471216 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452952 4497 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:08:25.471216 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452955 4497 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:08:25.471216 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452957 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:08:25.471216 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452961 4497 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:08:25.471216 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452965 4497 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:08:25.471216 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452969 4497 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:08:25.471216 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452973 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:08:25.471216 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452977 4497 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:08:25.471216 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452980 4497 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:08:25.471216 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452983 4497 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:08:25.471216 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452986 4497 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:08:25.472065 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452990 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:08:25.472065 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452995 4497 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:08:25.472065 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.452999 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:08:25.472065 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453003 4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:08:25.472065 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453007 4497 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:08:25.472065 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453012 4497 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:08:25.472065 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453017 4497 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:08:25.472065 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453022 4497 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:08:25.472065 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453026 4497 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:08:25.472065 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453030 4497 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:08:25.472065 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453034 4497 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:08:25.472065 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453039 4497 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:08:25.472065 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453044 4497 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:08:25.472065 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453049 4497 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:08:25.472065 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453053 4497 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:08:25.472065 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453059 4497 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:08:25.472065 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453064 4497 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:08:25.472065 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453068 4497 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:08:25.472065 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453074 4497 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:08:25.472065 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453078 4497 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:08:25.472901 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453082 4497 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:08:25.472901 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453085 4497 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:08:25.472901 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453087 4497 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:08:25.472901 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453091 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:08:25.472901 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453093 4497 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:08:25.472901 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453096 4497 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:08:25.472901 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453098 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:08:25.472901 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453101 4497 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:08:25.472901 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453104 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:08:25.472901 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453106 4497 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:08:25.472901 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453109 4497 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:08:25.472901 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453112 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:08:25.472901 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453114 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:08:25.472901 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453117 4497 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:08:25.472901 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453119 4497 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:08:25.472901 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453122 4497 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:08:25.472901 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453126 4497 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:08:25.472901 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453130 4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:08:25.472901 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453134 4497 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:08:25.472901 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453139 4497 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:08:25.473727 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453142 4497 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:08:25.473727 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453146 4497 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:08:25.473727 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453150 4497 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:08:25.473727 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453154 4497 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:08:25.473727 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453158 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:08:25.473727 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453162 4497 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:08:25.473727 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453166 4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:08:25.473727 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453169 4497 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:08:25.473727 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453174 4497 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:08:25.473727 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453177 4497 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:08:25.473727 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453179 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:08:25.473727 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453183 4497 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:08:25.473727 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453185 4497 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:08:25.473727 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.453223 4497 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 22:08:25.473727 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453283 4497 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:08:25.473727 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453290 4497 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:08:25.474359 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453295 4497 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:08:25.474359 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453299 4497 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:08:25.474359 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453304 4497 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:08:25.474359 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453309 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:08:25.474359 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453313 4497 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:08:25.474359 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453318 4497 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:08:25.474359 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453322 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:08:25.474359 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453327 4497 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:08:25.474359 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453332 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:08:25.474359 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453336 4497 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:08:25.474359 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453340 4497 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:08:25.474359 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453344 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:08:25.474359 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453348 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:08:25.474359 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453352 4497 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:08:25.474359 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453356 4497 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:08:25.474359 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453360 4497 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:08:25.474359 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453365 4497 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:08:25.474359 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453370 4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:08:25.474359 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453374 4497 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:08:25.474359 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453378 4497 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:08:25.475171 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453383 4497 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:08:25.475171 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453387 4497 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:08:25.475171 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453391 4497 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:08:25.475171 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453395 4497 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:08:25.475171 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453400 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:08:25.475171 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453403 4497 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:08:25.475171 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453406 4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:08:25.475171 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453410 4497 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:08:25.475171 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453414 4497 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:08:25.475171 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453419 4497 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:08:25.475171 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453423 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:08:25.475171 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453427 4497 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:08:25.475171 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453431 4497 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:08:25.475171 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453436 4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:08:25.475171 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453440 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:08:25.475171 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453446 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:08:25.475171 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453451 4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:08:25.475171 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453455 4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:08:25.475171 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453458 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:08:25.475950 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453460 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:08:25.475950 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453463 4497 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:08:25.475950 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453466 4497 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:08:25.475950 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453469 4497 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:08:25.475950 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453472 4497 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:08:25.475950 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453476 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:08:25.475950 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453480 4497 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:08:25.475950 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453484 4497 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:08:25.475950 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453488 4497 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:08:25.475950 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453493 4497 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:08:25.475950 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453499 4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:08:25.475950 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453503 4497 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:08:25.475950 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453508 4497 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:08:25.475950 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453512 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:08:25.475950 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453517 4497 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:08:25.475950 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453522 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:08:25.475950 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453527 4497 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:08:25.475950 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453531 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:08:25.475950 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453536 4497 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:08:25.475950 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453541 4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:08:25.476799 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453546 4497 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:08:25.476799 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453550 4497 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:08:25.476799 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453556 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:08:25.476799 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453559 4497 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:08:25.476799 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453566 4497 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:08:25.476799 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453574 4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:08:25.476799 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453579 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:08:25.476799 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453584 4497 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:08:25.476799 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453588 4497 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:08:25.476799 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453592 4497 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:08:25.476799 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453596 4497 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:08:25.476799 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453601 4497 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:08:25.476799 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453605 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:08:25.476799 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453608 4497 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:08:25.476799 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453612 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:08:25.476799 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453616 4497 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:08:25.476799 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453619 4497 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:08:25.476799 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453623 4497 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:08:25.476799 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453628 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:08:25.477528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453634 4497 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:08:25.477528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453639 4497 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:08:25.477528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453644 4497 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:08:25.477528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453648 4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:08:25.477528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453653 4497 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:08:25.477528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453657 4497 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:08:25.477528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453661 4497 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:08:25.477528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453665 4497 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:08:25.477528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453670 4497 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:08:25.477528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453675 4497 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:08:25.477528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453679 4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:08:25.477528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453684 4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:08:25.477528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453688 4497 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:08:25.477528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453692 4497 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:08:25.477528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453695 4497 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:08:25.477528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453697 4497 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:08:25.477528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453703 4497 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:08:25.477528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453706 4497 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:08:25.477528 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453708 4497 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:08:25.478270 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453711 4497 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:08:25.478270 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453714 4497 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:08:25.478270 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453718 4497 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:08:25.478270 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453722 4497 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:08:25.478270 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453727 4497 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:08:25.478270 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453731 4497 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:08:25.478270 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:25.453734 4497 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:08:25.478270 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.453822 4497 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 22:08:25.478270 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.455075 4497 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 30 22:08:25.478270 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.455137 4497 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 30 22:08:25.478270 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.455397 4497 server.go:1014] "Starting client certificate rotation" Oct 30 22:08:25.478270 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.455536 4497 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 22:08:25.478270 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.455595 4497 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 22:02:45 +0000 UTC" deadline="2028-03-31 11:29:38.612688151 +0000 UTC" Oct 30 22:08:25.478270 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.455644 4497 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12421h21m13.15704732s" Oct 30 22:08:25.478270 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.456095 4497 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 22:08:25.478270 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.457447 4497 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 22:08:25.478909 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.459187 4497 log.go:25] "Validated CRI v1 runtime API" Oct 30 22:08:25.478909 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.461116 4497 log.go:25] "Validated CRI v1 image API" Oct 30 22:08:25.478909 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.461984 4497 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 22:08:25.478909 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.464008 4497 fs.go:135] Filesystem UUIDs: map[55071cbe-ead8-4be4-9d71-6c7fdfbb7dfd:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 bbdf3398-c4c6-4c02-acb6-9a1e1317dc2a:/dev/nvme0n1p4] Oct 30 22:08:25.479055 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.464033 4497 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0adc30f27969d0ffff12733118e1fc30cec6134ebe5f9e7c31daadf260e878e3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0adc30f27969d0ffff12733118e1fc30cec6134ebe5f9e7c31daadf260e878e3/userdata/shm major:0 minor:95 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/195583dc2da7f59055751d45111553bba6c59bcd5ac786037ea4b8e64012eb46/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/195583dc2da7f59055751d45111553bba6c59bcd5ac786037ea4b8e64012eb46/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1d7a636fb33e6d7987bf570cb33b4fdaea46d437ef7a1bc2d163daf381e66496/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1d7a636fb33e6d7987bf570cb33b4fdaea46d437ef7a1bc2d163daf381e66496/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/20dbd160a27db871823d4261813f17186718bdc3a8aebd7ebf47260d3c714d87/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/20dbd160a27db871823d4261813f17186718bdc3a8aebd7ebf47260d3c714d87/userdata/shm major:0 minor:92 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2b8bdc3d3e6337bb3774dbf8ef97d75a13d48f3b236bda61837dec44797994d5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2b8bdc3d3e6337bb3774dbf8ef97d75a13d48f3b236bda61837dec44797994d5/userdata/shm major:0 minor:211 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2ba61a5f56077b56e059ca8a9d0da750142b5b5e02b3217f0bfe06c9f16ad059/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2ba61a5f56077b56e059ca8a9d0da750142b5b5e02b3217f0bfe06c9f16ad059/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/413f85621879dd946dc2198f4266f35170d19054c7d1ae29bbf8dcd55de768da/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/413f85621879dd946dc2198f4266f35170d19054c7d1ae29bbf8dcd55de768da/userdata/shm major:0 minor:202 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/665daed85bfa910e74dc6f2e893cc30d8b769f68613a0b179b35f921fb2667da/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/665daed85bfa910e74dc6f2e893cc30d8b769f68613a0b179b35f921fb2667da/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/85d23c975f0655f6a4491b5d86268bbe67017647d014dd4a0c2ef16ce4436b61/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/85d23c975f0655f6a4491b5d86268bbe67017647d014dd4a0c2ef16ce4436b61/userdata/shm major:0 minor:214 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/88bd07b7953c3534d7040d3f704dc5f6e16fb63e7890cb224371eabb16a6c229/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/88bd07b7953c3534d7040d3f704dc5f6e16fb63e7890cb224371eabb16a6c229/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/90220cac142f748324925c4cee506ff4ac60528f1a06e77eb39822b636fb788a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/90220cac142f748324925c4cee506ff4ac60528f1a06e77eb39822b636fb788a/userdata/shm major:0 minor:69 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9b1b5120282bb0179ed0d02db0a93c8b6acbcd92151efadc27b4764c7370090c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9b1b5120282bb0179ed0d02db0a93c8b6acbcd92151efadc27b4764c7370090c/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/af95f661f18489f4c1825303f5b9498d748f459ad7a32accac26550a33ef1aee/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/af95f661f18489f4c1825303f5b9498d748f459ad7a32accac26550a33ef1aee/userdata/shm major:0 minor:87 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d946a87d09e45f22fbf97b99023cc7f7482c0caa10841f3a5f8f5c9515245c9f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d946a87d09e45f22fbf97b99023cc7f7482c0caa10841f3a5f8f5c9515245c9f/userdata/shm major:0 minor:224 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/de780b32259c1d31c2029adacb114440bafef2acd3d774d58a40bc49e98a8e8f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/de780b32259c1d31c2029adacb114440bafef2acd3d774d58a40bc49e98a8e8f/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/edb4720170ec724a91b8559b0d69fe16af188e65aad94fc775b252281c783677/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/edb4720170ec724a91b8559b0d69fe16af188e65aad94fc775b252281c783677/userdata/shm major:0 minor:237 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/01279335-4077-4099-85cb-ec0ed9925c7b/volumes/kubernetes.io~projected/kube-api-access-g7cws:{mountpoint:/var/lib/kubelet/pods/01279335-4077-4099-85cb-ec0ed9925c7b/volumes/kubernetes.io~projected/kube-api-access-g7cws major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/02b6cf19-863a-4c44-89e9-ccfd393bbf59/volumes/kubernetes.io~projected/kube-api-access-8qhkv:{mountpoint:/var/lib/kubelet/pods/02b6cf19-863a-4c44-89e9-ccfd393bbf59/volumes/kubernetes.io~projected/kube-api-access-8qhkv major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/14afa5d3-bd87-4cb2-9c75-9059d4072250/volumes/kubernetes.io~projected/kube-api-access-qrbdv:{mountpoint:/var/lib/kubelet/pods/14afa5d3-bd87-4cb2-9c75-9059d4072250/volumes/kubernetes.io~projected/kube-api-access-qrbdv major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5a0a698f-3051-4639-90c8-e4385348feea/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/5a0a698f-3051-4639-90c8-e4385348feea/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5a0a698f-3051-4639-90c8-e4385348feea/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/5a0a698f-3051-4639-90c8-e4385348feea/volumes/kubernetes.io~empty-dir/tmp major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5a0a698f-3051-4639-90c8-e4385348feea/volumes/kubernetes.io~projected/kube-api-access-kwpl5:{mountpoint:/var/lib/kubelet/pods/5a0a698f-3051-4639-90c8-e4385348feea/volumes/kubernetes.io~projected/kube-api-access-kwpl5 major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/84c4be79-ca4e-464e-9bfa-71c48c45b67d/volumes/kubernetes.io~projected/kube-api-access-kmcxj:{mountpoint:/var/lib/kubelet/pods/84c4be79-ca4e-464e-9bfa-71c48c45b67d/volumes/kubernetes.io~projected/kube-api-access-kmcxj major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a56c9584-f976-4ce6-a18a-946c6e24ff21/volumes/kubernetes.io~projected/kube-api-access-m7mkn:{mountpoint:/var/lib/kubelet/pods/a56c9584-f976-4ce6-a18a-946c6e24ff21/volumes/kubernetes.io~projected/kube-api-access-m7mkn major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a70a380d-f1e4-4128-bb5c-db16f19662e6/volumes/kubernetes.io~projected/kube-api-access-56mp6:{mountpoint:/var/lib/kubelet/pods/a70a380d-f1e4-4128-bb5c-db16f19662e6/volumes/kubernetes.io~projected/kube-api-access-56mp6 major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a9cc4dd2-875f-412d-bf36-880c5f383193/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/a9cc4dd2-875f-412d-bf36-880c5f383193/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a9cc4dd2-875f-412d-bf36-880c5f383193/volumes/kubernetes.io~projected/kube-api-access-8lbss:{mountpoint:/var/lib/kubelet/pods/a9cc4dd2-875f-412d-bf36-880c5f383193/volumes/kubernetes.io~projected/kube-api-access-8lbss major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a9cc4dd2-875f-412d-bf36-880c5f383193/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/a9cc4dd2-875f-412d-bf36-880c5f383193/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aec2e919-1d2a-4605-ba3b-d6f973ef036a/volumes/kubernetes.io~projected/kube-api-access-s8fmp:{mountpoint:/var/lib/kubelet/pods/aec2e919-1d2a-4605-ba3b-d6f973ef036a/volumes/kubernetes.io~projected/kube-api-access-s8fmp major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bb1d231f-4920-49d0-bd0c-4a23690b2956/volumes/kubernetes.io~projected/kube-api-access-46xsc:{mountpoint:/var/lib/kubelet/pods/bb1d231f-4920-49d0-bd0c-4a23690b2956/volumes/kubernetes.io~projected/kube-api-access-46xsc major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/be4e3e6b-42e3-4ebd-ac88-8b45ab253747/volumes/kubernetes.io~projected/kube-api-access-zrm8z:{mountpoint:/var/lib/kubelet/pods/be4e3e6b-42e3-4ebd-ac88-8b45ab253747/volumes/kubernetes.io~projected/kube-api-access-zrm8z major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7/volumes/kubernetes.io~projected/kube-api-access-sn5dk:{mountpoint:/var/lib/kubelet/pods/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7/volumes/kubernetes.io~projected/kube-api-access-sn5dk major:0 minor:234 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7/volumes/kubernetes.io~secret/signing-key major:0 minor:233 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d8a728f8-1427-4a89-8102-6580684a157d/volumes/kubernetes.io~projected/kube-api-access-6lv7v:{mountpoint:/var/lib/kubelet/pods/d8a728f8-1427-4a89-8102-6580684a157d/volumes/kubernetes.io~projected/kube-api-access-6lv7v major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d9695030-e34c-40b4-90d1-93cc907cd491/volumes/kubernetes.io~projected/kube-api-access-7kkxd:{mountpoint:/var/lib/kubelet/pods/d9695030-e34c-40b4-90d1-93cc907cd491/volumes/kubernetes.io~projected/kube-api-access-7kkxd major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e456cbb1-7bc3-4d01-aea9-2af2c8addf39/volumes/kubernetes.io~projected/kube-api-access-rfcs4:{mountpoint:/var/lib/kubelet/pods/e456cbb1-7bc3-4d01-aea9-2af2c8addf39/volumes/kubernetes.io~projected/kube-api-access-rfcs4 major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e456cbb1-7bc3-4d01-aea9-2af2c8addf39/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/e456cbb1-7bc3-4d01-aea9-2af2c8addf39/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f20cb0c1-6f52-41e1-978d-f59baf6bab48/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/f20cb0c1-6f52-41e1-978d-f59baf6bab48/volumes/kubernetes.io~secret/agent-certs major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85/volumes/kubernetes.io~projected/kube-api-access-rdb9n:{mountpoint:/var/lib/kubelet/pods/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85/volumes/kubernetes.io~projected/kube-api-access-rdb9n major:0 minor:64 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/a1962e54fe4f1453371725a0f4d9fc97a31f91db2510999992b52b3dd70cc07b/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/f857b25f27800e37640071529ae1d1e84b3e1a04b7b411bc102e0b3fa6e7d833/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/a6ceeac48079e8852036d9db883b65478acefd18a817d6868f11162f6509f3e2/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-112:{mountpoint:/var/lib/containers/storage/overlay/7d894813d833c0071962a5d8b800e6c7285258ee1a8691e76d5a3687727a9dd2/merged major:0 minor:112 fsType:overlay blockSize:0} overlay_0-113:{mountpoint:/var/lib/containers/storage/overlay/171e0177786f243b8dec20544b53b54e941467755b50301520bc65691fd4ff20/merged major:0 minor:113 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/4af04f85b75541a265a674d5741f42fd49cffb60059ce14dc2ccd6ac83b306de/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/3880cdb296054d678981c3918ec27fb2a974212c4919275a5c580f59ba43dfb4/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/0cef5cf5f7b6caa9cde239903ea7d7886054cef5650e19cdbca0987a92c827cf/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/2c3a40223c9962dda79535381238d792b8dd06090a5b435f88aef8d6d5fb5dc6/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/7526afa1cd7f3c26a53aa0526479605e118f6d0d1dc533e56d4bf983ee8b2222/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-142:{mountpoint:/var/lib/containers/storage/overlay/7dae5842a3214cc4642c4e7eff40e6f664d15adb0dec9ef7e56f983f08a8163e/merged major:0 minor:142 fsType:overlay blockSize:0} overlay_0-147:{mountpoint:/var/lib/containers/storage/overlay/298027371ffb4c8b229b8d64bb3be1f2ab0ad9ef688c2c01dccec1dadaedf3dc/merged major:0 minor:147 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/9bd069036358173cadbfe43678f7e88276a75effc45690e49f0132e9cf2f95e4/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-154:{mountpoint:/var/lib/containers/storage/overlay/c363d9fa366d0e4cbda2e91fa44d8c038960ca92f7b1c27b1c2304678beb67fd/merged major:0 minor:154 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/fd2b003044848cbf3ea412595570843b3e1f4b3a3414a8a0fc2ece7d6af38a56/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/c14275f14e9cc7e91e0f30e669a772c7ceabc99ccbce38c47fdf5d38c5a68b3f/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-169:{mountpoint:/var/lib/containers/storage/overlay/57388b4ac5665753213eedb6738d1247b66668d40380f40a558e36f5ee5d8a51/merged major:0 minor:169 fsType:overlay blockSize:0} overlay_0-174:{mountpoint:/var/lib/containers/storage/overlay/7c01f11d831e70638dc8242703a35013483b272dc452ef04dd5a629b19f89702/merged major:0 minor:174 fsType:overlay blockSize:0} overlay_0-176:{mountpoint:/var/lib/containers/storage/overlay/a09f00f6e48126a5d7db6a952acda21395aca1532b2dc845ebf97f322a37fbb3/merged major:0 minor:176 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/cdb181946998212b63f03ef1388de261c0665912dd79e2e5bb866aed608a7b43/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/0ed2fd63987b076d6668039225578eab9378de3987756e68814805db20fa8553/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-204:{mountpoint:/var/lib/containers/storage/overlay/e12ff5019abcd2c534bb6978c0d82de7f2cfdc8b7ea65c85c21b9def6d3713c6/merged major:0 minor:204 fsType:overlay blockSize:0} overlay_0-216:{mountpoint:/var/lib/containers/storage/overlay/745de7e94240c8347dc7e6966519abd85e1007e233b0d8999f950998e638f579/merged major:0 minor:216 fsType:overlay blockSize:0} overlay_0-218:{mountpoint:/var/lib/containers/storage/overlay/421cc15f99e2e635e07c13ee621ccb41f98f14d0900fe607ff4f08658e0bd609/merged major:0 minor:218 fsType:overlay blockSize:0} overlay_0-220:{mountpoint:/var/lib/containers/storage/overlay/a78593c114d2684a8b23d8eb51c938ee13a8c2896f303dd68a63cb6ba2b87287/merged major:0 minor:220 fsType:overlay blockSize:0} overlay_0-222:{mountpoint:/var/lib/containers/storage/overlay/1bb42f90ef8ec5b4b029b6a8aa6a9cbc41121db78e8123db5a6acd161015da66/merged major:0 minor:222 fsType:overlay blockSize:0} overlay_0-231:{mountpoint:/var/lib/containers/storage/overlay/790eff2f07a9b4ed0592df77c7d04c991b067ffe8b2649f972f5c413c7e57830/merged major:0 minor:231 fsType:overlay blockSize:0} overlay_0-235:{mountpoint:/var/lib/containers/storage/overlay/12dad348b6e79a5c8a680dcfb01cab9cb892939c695830bf9d2e00eb436f3a00/merged major:0 minor:235 fsType:overlay blockSize:0} overlay_0-239:{mountpoint:/var/lib/containers/storage/overlay/4be78f00091a7033ce830ef3f55075a7e1f84b5c0d1794f72912aed80bab4ccb/merged major:0 minor:239 fsType:overlay blockSize:0} overlay_0-245:{mountpoint:/var/lib/containers/storage/overlay/989ed51e8b44d9e203f1f1ce750976245edd0ea5caab0f958601673363c3d4d2/merged major:0 minor:245 fsType:overlay blockSize:0} overlay_0-247:{mountpoint:/var/lib/containers/storage/overlay/6196cd8221b0240b55e1b4be2ad08c576d0626bbcd2d3b38c2bb7e9da96528ca/merged major:0 minor:247 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/7ade01f53de611d544e98b2b4f53dabda59c0a33dbb277fbcc21bdac5ccb9375/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/ffa0fef4f9b9de4998f858b8e228b73675123f81ae8254c158e39f7deb9526e8/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/d4322ac9c76ab7eff9e5b2449539445082e4a8fe865a511afa8ea368a08697ba/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/76931e6ac7a93769c04971a9e0866089b32860bff9bfbf4452805ec8ff0b47b1/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/c701b894b54b0b134c3b0d938e74d71a31d75d91c2cd05e6788dcd8046ab5582/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/d25e2fe15050ba61bf117dfcac052337f213ed9dc2fef0d50766249fca668c3e/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/84d60fb68fead436387ea3f7ec1e2407f35e2094b54cabf52a0b7cf134945c40/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/00a36f0d3b04b8a0f1166d1754100bb4726736a684541e940f9bcaedf7ed2c2f/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/d094343ad2baf0c6e5b46e83bd6df285846e395ed7ae0fa995ce88b7e0778a51/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/8749e1f4d330955173ad4601aedd1e677b2867138fe7ec2b5bafe294ca3b2665/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-98:{mountpoint:/var/lib/containers/storage/overlay/e539ca3db297577f90f01338911d895b85e04d3a56df92d2b897d2a8a292389c/merged major:0 minor:98 fsType:overlay blockSize:0}] Oct 30 22:08:25.479326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.473137 4497 manager.go:217] Machine: {Timestamp:2026-10-30 22:08:25.472534743 +0000 UTC m=+0.099600285 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099945 MemoryCapacity:32812007424 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec256b0e820bc613be9a99c1edcd8b22 SystemUUID:ec256b0e-820b-c613-be9a-99c1edcd8b22 BootID:33cc6562-ad9c-4235-b726-13a9f92d9252 Filesystems:[{Device:overlay_0-247 DeviceMajor:0 DeviceMinor:247 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d8a728f8-1427-4a89-8102-6580684a157d/volumes/kubernetes.io~projected/kube-api-access-6lv7v DeviceMajor:0 DeviceMinor:62 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/20dbd160a27db871823d4261813f17186718bdc3a8aebd7ebf47260d3c714d87/userdata/shm DeviceMajor:0 DeviceMinor:92 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a9cc4dd2-875f-412d-bf36-880c5f383193/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562402304 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/aec2e919-1d2a-4605-ba3b-d6f973ef036a/volumes/kubernetes.io~projected/kube-api-access-s8fmp DeviceMajor:0 DeviceMinor:206 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/a9cc4dd2-875f-412d-bf36-880c5f383193/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:58 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1d7a636fb33e6d7987bf570cb33b4fdaea46d437ef7a1bc2d163daf381e66496/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bb1d231f-4920-49d0-bd0c-4a23690b2956/volumes/kubernetes.io~projected/kube-api-access-46xsc DeviceMajor:0 DeviceMinor:63 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9b1b5120282bb0179ed0d02db0a93c8b6acbcd92151efadc27b4764c7370090c/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/195583dc2da7f59055751d45111553bba6c59bcd5ac786037ea4b8e64012eb46/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-174 DeviceMajor:0 DeviceMinor:174 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-204 DeviceMajor:0 DeviceMinor:204 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-220 DeviceMajor:0 DeviceMinor:220 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2b8bdc3d3e6337bb3774dbf8ef97d75a13d48f3b236bda61837dec44797994d5/userdata/shm DeviceMajor:0 DeviceMinor:211 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/665daed85bfa910e74dc6f2e893cc30d8b769f68613a0b179b35f921fb2667da/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0adc30f27969d0ffff12733118e1fc30cec6134ebe5f9e7c31daadf260e878e3/userdata/shm DeviceMajor:0 DeviceMinor:95 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-169 DeviceMajor:0 DeviceMinor:169 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/413f85621879dd946dc2198f4266f35170d19054c7d1ae29bbf8dcd55de768da/userdata/shm DeviceMajor:0 DeviceMinor:202 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-239 DeviceMajor:0 DeviceMinor:239 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/01279335-4077-4099-85cb-ec0ed9925c7b/volumes/kubernetes.io~projected/kube-api-access-g7cws DeviceMajor:0 DeviceMinor:56 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/f20cb0c1-6f52-41e1-978d-f59baf6bab48/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:57 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-113 DeviceMajor:0 DeviceMinor:113 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:233 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406003712 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/88bd07b7953c3534d7040d3f704dc5f6e16fb63e7890cb224371eabb16a6c229/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/a9cc4dd2-875f-412d-bf36-880c5f383193/volumes/kubernetes.io~projected/kube-api-access-8lbss DeviceMajor:0 DeviceMinor:65 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/85d23c975f0655f6a4491b5d86268bbe67017647d014dd4a0c2ef16ce4436b61/userdata/shm DeviceMajor:0 DeviceMinor:214 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-218 DeviceMajor:0 DeviceMinor:218 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-222 DeviceMajor:0 DeviceMinor:222 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d946a87d09e45f22fbf97b99023cc7f7482c0caa10841f3a5f8f5c9515245c9f/userdata/shm DeviceMajor:0 DeviceMinor:224 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-231 DeviceMajor:0 DeviceMinor:231 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/run/containers/storage/overlay-containers/90220cac142f748324925c4cee506ff4ac60528f1a06e77eb39822b636fb788a/userdata/shm DeviceMajor:0 DeviceMinor:69 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/edb4720170ec724a91b8559b0d69fe16af188e65aad94fc775b252281c783677/userdata/shm DeviceMajor:0 DeviceMinor:237 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-112 DeviceMajor:0 DeviceMinor:112 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-142 DeviceMajor:0 DeviceMinor:142 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-176 DeviceMajor:0 DeviceMinor:176 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/84c4be79-ca4e-464e-9bfa-71c48c45b67d/volumes/kubernetes.io~projected/kube-api-access-kmcxj DeviceMajor:0 DeviceMinor:201 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85/volumes/kubernetes.io~projected/kube-api-access-rdb9n DeviceMajor:0 DeviceMinor:64 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/be4e3e6b-42e3-4ebd-ac88-8b45ab253747/volumes/kubernetes.io~projected/kube-api-access-zrm8z DeviceMajor:0 DeviceMinor:66 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-235 DeviceMajor:0 DeviceMinor:235 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562402304 Type:vfs Inodes:819200 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406003712 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/14afa5d3-bd87-4cb2-9c75-9059d4072250/volumes/kubernetes.io~projected/kube-api-access-qrbdv DeviceMajor:0 DeviceMinor:55 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/5a0a698f-3051-4639-90c8-e4385348feea/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:59 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a70a380d-f1e4-4128-bb5c-db16f19662e6/volumes/kubernetes.io~projected/kube-api-access-56mp6 DeviceMajor:0 DeviceMinor:227 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7/volumes/kubernetes.io~projected/kube-api-access-sn5dk DeviceMajor:0 DeviceMinor:234 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/02b6cf19-863a-4c44-89e9-ccfd393bbf59/volumes/kubernetes.io~projected/kube-api-access-8qhkv DeviceMajor:0 DeviceMinor:61 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/af95f661f18489f4c1825303f5b9498d748f459ad7a32accac26550a33ef1aee/userdata/shm DeviceMajor:0 DeviceMinor:87 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-147 DeviceMajor:0 DeviceMinor:147 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e456cbb1-7bc3-4d01-aea9-2af2c8addf39/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/d9695030-e34c-40b4-90d1-93cc907cd491/volumes/kubernetes.io~projected/kube-api-access-7kkxd DeviceMajor:0 DeviceMinor:213 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/5a0a698f-3051-4639-90c8-e4385348feea/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:60 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-98 DeviceMajor:0 DeviceMinor:98 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e456cbb1-7bc3-4d01-aea9-2af2c8addf39/volumes/kubernetes.io~projected/kube-api-access-rfcs4 DeviceMajor:0 DeviceMinor:197 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/de780b32259c1d31c2029adacb114440bafef2acd3d774d58a40bc49e98a8e8f/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-216 DeviceMajor:0 DeviceMinor:216 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-245 DeviceMajor:0 DeviceMinor:245 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2ba61a5f56077b56e059ca8a9d0da750142b5b5e02b3217f0bfe06c9f16ad059/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/a56c9584-f976-4ce6-a18a-946c6e24ff21/volumes/kubernetes.io~projected/kube-api-access-m7mkn DeviceMajor:0 DeviceMinor:208 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5a0a698f-3051-4639-90c8-e4385348feea/volumes/kubernetes.io~projected/kube-api-access-kwpl5 DeviceMajor:0 DeviceMinor:67 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-154 DeviceMajor:0 DeviceMinor:154 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:207 Capacity:31633408000 Type:vfs Inodes:4005372 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:2b8bdc3d3e6337b MacAddress:c6:ba:82:c8:ea:08 Speed:10000 Mtu:8901} {Name:413f85621879dd9 MacAddress:fa:bf:6a:dd:ba:80 Speed:10000 Mtu:8901} {Name:85d23c975f0655f MacAddress:fe:2e:8d:89:a7:8a Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:0a:42:92:05:5b Speed:0 Mtu:9001} {Name:br-int MacAddress:66:d9:39:4b:ae:4c Speed:0 Mtu:8901} {Name:d946a87d09e45f2 MacAddress:ca:a4:bf:67:19:87 Speed:10000 Mtu:8901} {Name:de780b32259c1d3 MacAddress:1a:13:9f:48:07:87 Speed:10000 Mtu:8901} {Name:edb4720170ec724 MacAddress:96:84:00:67:76:06 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:0a:42:92:05:5b Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:da:10:51:84:23:54 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:82:f9:24:35:20:39 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812007424 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 22:08:25.479326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.473467 4497 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 22:08:25.479326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.473526 4497 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 22:08:25.479326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.473868 4497 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 22:08:25.479326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.473893 4497 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-150.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 22:08:25.479326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.474070 4497 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 22:08:25.479326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.474081 4497 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 22:08:25.479326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.474095 4497 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 22:08:25.479326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.474128 4497 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 22:08:25.479326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.474207 4497 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 22:08:25.479326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.474403 4497 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 22:08:25.479326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.474656 4497 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 22:08:25.479326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.474762 4497 kubelet.go:493] "Attempting to sync node with API server" Oct 30 22:08:25.479326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.474795 4497 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 22:08:25.479326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.474811 4497 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 22:08:25.479326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.474827 4497 kubelet.go:405] "Adding apiserver pod source" Oct 30 22:08:25.479326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.474838 4497 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 22:08:25.479326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.475696 4497 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 22:08:25.479326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.475710 4497 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 22:08:25.479326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.477816 4497 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 22:08:25.490202 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.490183 4497 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 22:08:25.490202 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.490202 4497 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 22:08:25.490390 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.490366 4497 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 30 22:08:25.490740 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.490652 4497 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 22:08:25.490740 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.490697 4497 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 22:08:25.490861 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.490822 4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 22:08:25.490861 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.490841 4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 22:08:25.490861 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.490850 4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 22:08:25.490861 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.490858 4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 22:08:25.491017 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.490867 4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 22:08:25.491017 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.490877 4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 22:08:25.491017 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.490886 4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 22:08:25.491017 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.490897 4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 22:08:25.491017 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.490908 4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 22:08:25.491017 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.490916 4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 22:08:25.491017 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.490925 4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 22:08:25.491017 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.490935 4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 22:08:25.491017 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.490970 4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 22:08:25.491017 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.490981 4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 22:08:25.495101 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.495083 4497 server.go:1263] "Started kubelet" Oct 30 22:08:25.495225 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.495169 4497 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 22:08:25.495539 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.495440 4497 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 22:08:25.495614 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.495516 4497 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 22:08:25.495656 ip-10-0-129-150 systemd[1]: Started Kubernetes Kubelet. Oct 30 22:08:25.495916 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.495890 4497 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 22:08:25.496674 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.496617 4497 server.go:317] "Adding debug handlers to kubelet server" Oct 30 22:08:25.497681 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.497665 4497 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 22:08:25.497913 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.497890 4497 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 22:08:25.498049 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.498008 4497 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 22:08:25.498049 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.498029 4497 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 22:08:25.498185 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.498041 4497 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 22:02:46 +0000 UTC" deadline="2028-06-08 16:03:14.312143183 +0000 UTC" Oct 30 22:08:25.498185 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.498075 4497 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14081h54m48.814072081s" Oct 30 22:08:25.498185 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.498090 4497 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 22:08:25.498185 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:25.498152 4497 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-129-150.us-west-1.compute.internal\" not found" Oct 30 22:08:25.499370 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499335 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="84c4be79-ca4e-464e-9bfa-71c48c45b67d" volumeName="kubernetes.io/projected/84c4be79-ca4e-464e-9bfa-71c48c45b67d-kube-api-access-kmcxj" seLinuxMountContext="" Oct 30 22:08:25.499370 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499367 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a9cc4dd2-875f-412d-bf36-880c5f383193" volumeName="kubernetes.io/secret/a9cc4dd2-875f-412d-bf36-880c5f383193-ovn-node-metrics-cert" seLinuxMountContext="" Oct 30 22:08:25.499522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499377 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d8a728f8-1427-4a89-8102-6580684a157d" volumeName="kubernetes.io/configmap/d8a728f8-1427-4a89-8102-6580684a157d-multus-daemon-config" seLinuxMountContext="" Oct 30 22:08:25.499522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499385 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f20cb0c1-6f52-41e1-978d-f59baf6bab48" volumeName="kubernetes.io/configmap/f20cb0c1-6f52-41e1-978d-f59baf6bab48-konnectivity-ca" seLinuxMountContext="" Oct 30 22:08:25.499522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499393 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85" volumeName="kubernetes.io/projected/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85-kube-api-access-rdb9n" seLinuxMountContext="" Oct 30 22:08:25.499522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499402 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a0a698f-3051-4639-90c8-e4385348feea" volumeName="kubernetes.io/empty-dir/5a0a698f-3051-4639-90c8-e4385348feea-tmp" seLinuxMountContext="" Oct 30 22:08:25.499522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499414 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="84c4be79-ca4e-464e-9bfa-71c48c45b67d" volumeName="kubernetes.io/configmap/84c4be79-ca4e-464e-9bfa-71c48c45b67d-config-volume" seLinuxMountContext="" Oct 30 22:08:25.499522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499421 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a56c9584-f976-4ce6-a18a-946c6e24ff21" volumeName="kubernetes.io/projected/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-api-access-m7mkn" seLinuxMountContext="" Oct 30 22:08:25.499522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499429 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a9cc4dd2-875f-412d-bf36-880c5f383193" volumeName="kubernetes.io/configmap/a9cc4dd2-875f-412d-bf36-880c5f383193-env-overrides" seLinuxMountContext="" Oct 30 22:08:25.499522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499437 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a9cc4dd2-875f-412d-bf36-880c5f383193" volumeName="kubernetes.io/configmap/a9cc4dd2-875f-412d-bf36-880c5f383193-ovnkube-config" seLinuxMountContext="" Oct 30 22:08:25.499522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499444 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bb1d231f-4920-49d0-bd0c-4a23690b2956" volumeName="kubernetes.io/configmap/bb1d231f-4920-49d0-bd0c-4a23690b2956-iptables-alerter-script" seLinuxMountContext="" Oct 30 22:08:25.499522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499451 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ce692f4a-8f69-4923-bcb4-bb39a7cc5de7" volumeName="kubernetes.io/secret/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7-signing-key" seLinuxMountContext="" Oct 30 22:08:25.499522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499458 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e456cbb1-7bc3-4d01-aea9-2af2c8addf39" volumeName="kubernetes.io/projected/e456cbb1-7bc3-4d01-aea9-2af2c8addf39-kube-api-access-rfcs4" seLinuxMountContext="" Oct 30 22:08:25.499522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499465 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a0a698f-3051-4639-90c8-e4385348feea" volumeName="kubernetes.io/projected/5a0a698f-3051-4639-90c8-e4385348feea-kube-api-access-kwpl5" seLinuxMountContext="" Oct 30 22:08:25.499522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499474 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a70a380d-f1e4-4128-bb5c-db16f19662e6" volumeName="kubernetes.io/projected/a70a380d-f1e4-4128-bb5c-db16f19662e6-kube-api-access-56mp6" seLinuxMountContext="" Oct 30 22:08:25.499522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499485 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a9cc4dd2-875f-412d-bf36-880c5f383193" volumeName="kubernetes.io/configmap/a9cc4dd2-875f-412d-bf36-880c5f383193-ovnkube-script-lib" seLinuxMountContext="" Oct 30 22:08:25.499522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499502 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aec2e919-1d2a-4605-ba3b-d6f973ef036a" volumeName="kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp" seLinuxMountContext="" Oct 30 22:08:25.499522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499510 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ce692f4a-8f69-4923-bcb4-bb39a7cc5de7" volumeName="kubernetes.io/configmap/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7-signing-cabundle" seLinuxMountContext="" Oct 30 22:08:25.499522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499516 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d8a728f8-1427-4a89-8102-6580684a157d" volumeName="kubernetes.io/configmap/d8a728f8-1427-4a89-8102-6580684a157d-cni-binary-copy" seLinuxMountContext="" Oct 30 22:08:25.499522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499526 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="01279335-4077-4099-85cb-ec0ed9925c7b" volumeName="kubernetes.io/configmap/01279335-4077-4099-85cb-ec0ed9925c7b-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 30 22:08:25.499522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499537 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="02b6cf19-863a-4c44-89e9-ccfd393bbf59" volumeName="kubernetes.io/configmap/02b6cf19-863a-4c44-89e9-ccfd393bbf59-serviceca" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499544 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a56c9584-f976-4ce6-a18a-946c6e24ff21" volumeName="kubernetes.io/empty-dir/a56c9584-f976-4ce6-a18a-946c6e24ff21-data-volume" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499553 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bb1d231f-4920-49d0-bd0c-4a23690b2956" volumeName="kubernetes.io/projected/bb1d231f-4920-49d0-bd0c-4a23690b2956-kube-api-access-46xsc" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499564 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f20cb0c1-6f52-41e1-978d-f59baf6bab48" volumeName="kubernetes.io/secret/f20cb0c1-6f52-41e1-978d-f59baf6bab48-agent-certs" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499574 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85" volumeName="kubernetes.io/empty-dir/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85-tmp-dir" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499584 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="02b6cf19-863a-4c44-89e9-ccfd393bbf59" volumeName="kubernetes.io/projected/02b6cf19-863a-4c44-89e9-ccfd393bbf59-kube-api-access-8qhkv" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499598 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="14afa5d3-bd87-4cb2-9c75-9059d4072250" volumeName="kubernetes.io/projected/14afa5d3-bd87-4cb2-9c75-9059d4072250-kube-api-access-qrbdv" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499609 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a0a698f-3051-4639-90c8-e4385348feea" volumeName="kubernetes.io/empty-dir/5a0a698f-3051-4639-90c8-e4385348feea-etc-tuned" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499620 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a9cc4dd2-875f-412d-bf36-880c5f383193" volumeName="kubernetes.io/projected/a9cc4dd2-875f-412d-bf36-880c5f383193-kube-api-access-8lbss" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499628 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d9695030-e34c-40b4-90d1-93cc907cd491" volumeName="kubernetes.io/projected/d9695030-e34c-40b4-90d1-93cc907cd491-kube-api-access-7kkxd" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499636 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="01279335-4077-4099-85cb-ec0ed9925c7b" volumeName="kubernetes.io/configmap/01279335-4077-4099-85cb-ec0ed9925c7b-cni-sysctl-allowlist" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499647 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d9695030-e34c-40b4-90d1-93cc907cd491" volumeName="kubernetes.io/configmap/d9695030-e34c-40b4-90d1-93cc907cd491-trusted-ca-bundle" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499659 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="be4e3e6b-42e3-4ebd-ac88-8b45ab253747" volumeName="kubernetes.io/projected/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-kube-api-access-zrm8z" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499671 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d9695030-e34c-40b4-90d1-93cc907cd491" volumeName="kubernetes.io/configmap/d9695030-e34c-40b4-90d1-93cc907cd491-service-ca-bundle" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499691 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d9695030-e34c-40b4-90d1-93cc907cd491" volumeName="kubernetes.io/empty-dir/d9695030-e34c-40b4-90d1-93cc907cd491-archives-path" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499703 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e456cbb1-7bc3-4d01-aea9-2af2c8addf39" volumeName="kubernetes.io/secret/e456cbb1-7bc3-4d01-aea9-2af2c8addf39-cert" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499716 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="01279335-4077-4099-85cb-ec0ed9925c7b" volumeName="kubernetes.io/projected/01279335-4077-4099-85cb-ec0ed9925c7b-kube-api-access-g7cws" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499729 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be" volumeName="kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499742 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ce692f4a-8f69-4923-bcb4-bb39a7cc5de7" volumeName="kubernetes.io/projected/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7-kube-api-access-sn5dk" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499752 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d8a728f8-1427-4a89-8102-6580684a157d" volumeName="kubernetes.io/projected/d8a728f8-1427-4a89-8102-6580684a157d-kube-api-access-6lv7v" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499764 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="01279335-4077-4099-85cb-ec0ed9925c7b" volumeName="kubernetes.io/configmap/01279335-4077-4099-85cb-ec0ed9925c7b-cni-binary-copy" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499778 4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="84c4be79-ca4e-464e-9bfa-71c48c45b67d" volumeName="kubernetes.io/empty-dir/84c4be79-ca4e-464e-9bfa-71c48c45b67d-tmp-dir" seLinuxMountContext="" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499790 4497 reconstruct.go:97] "Volume reconstruction finished" Oct 30 22:08:25.500447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.499802 4497 reconciler.go:29] "Reconciler: start to sync state" Oct 30 22:08:25.502046 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.502027 4497 factory.go:153] Registering CRI-O factory Oct 30 22:08:25.502124 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.502052 4497 factory.go:223] Registration of the crio container factory successfully Oct 30 22:08:25.502124 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.502102 4497 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 22:08:25.502124 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.502118 4497 factory.go:55] Registering systemd factory Oct 30 22:08:25.502124 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.502126 4497 factory.go:223] Registration of the systemd container factory successfully Oct 30 22:08:25.502340 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.502141 4497 factory.go:103] Registering Raw factory Oct 30 22:08:25.502340 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.502154 4497 manager.go:1199] Started watching for new ooms in manager Oct 30 22:08:25.504325 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.504305 4497 manager.go:319] Starting recovery of all containers Oct 30 22:08:25.531767 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.531723 4497 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 22:08:25.533784 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.533734 4497 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 22:08:25.533784 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.533786 4497 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 22:08:25.533915 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.533807 4497 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 22:08:25.533915 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:25.533875 4497 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 30 22:08:25.539904 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.539881 4497 generic.go:356] "Generic (PLEG): container finished" podID="a0c404c8d77f01c057faf5619397a983" containerID="0f948638a55df585021b8f29d3b7e041dd49c1f0d928b81ace7206f1f3aaea5f" exitCode=0 Oct 30 22:08:25.562839 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.562811 4497 generic.go:356] "Generic (PLEG): container finished" podID="01279335-4077-4099-85cb-ec0ed9925c7b" containerID="53d7db460f18875097337e862e50f4e0132a81458334d453eb9c57ac11759cfe" exitCode=0 Oct 30 22:08:25.562839 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.562840 4497 generic.go:356] "Generic (PLEG): container finished" podID="01279335-4077-4099-85cb-ec0ed9925c7b" containerID="2d18d7144057b8e26bdba8d2dd31ea9dcecef5e27541ead67e4a16868a20bc1a" exitCode=0 Oct 30 22:08:25.563013 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.562850 4497 generic.go:356] "Generic (PLEG): container finished" podID="01279335-4077-4099-85cb-ec0ed9925c7b" containerID="20893e6c6664d3fc5cd159bc7ebe34d5c5d46725638afde53c2529208b587570" exitCode=0 Oct 30 22:08:25.563013 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.562861 4497 generic.go:356] "Generic (PLEG): container finished" podID="01279335-4077-4099-85cb-ec0ed9925c7b" containerID="7827f32081e9a159936a87d0b154d7a33e9c1e020be4e3e7295ed31704646e74" exitCode=0 Oct 30 22:08:25.563013 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.562870 4497 generic.go:356] "Generic (PLEG): container finished" podID="01279335-4077-4099-85cb-ec0ed9925c7b" containerID="f05fd56b41ed0948817d82cd17f18b2fa4ed00e8c98bdb43b7ad7f6863d91a43" exitCode=0 Oct 30 22:08:25.563013 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.562879 4497 generic.go:356] "Generic (PLEG): container finished" podID="01279335-4077-4099-85cb-ec0ed9925c7b" containerID="6218cde8202e78a5a7a45c37b47111e3ee15e33f9c6af216c86f6c0e29152bb9" exitCode=0 Oct 30 22:08:25.578960 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.578914 4497 manager.go:324] Recovery completed Oct 30 22:08:25.598284 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:25.598257 4497 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-129-150.us-west-1.compute.internal\" not found" Oct 30 22:08:25.599125 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.599099 4497 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:08:25.600457 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.600438 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientMemory" Oct 30 22:08:25.600543 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.600472 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Oct 30 22:08:25.600543 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.600484 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientPID" Oct 30 22:08:25.602286 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.602269 4497 cpu_manager.go:226] "Starting" policy="none" Oct 30 22:08:25.602286 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.602284 4497 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 22:08:25.602443 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.602303 4497 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 22:08:25.602496 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.602451 4497 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 30 22:08:25.602496 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.602466 4497 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 30 22:08:25.602496 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.602488 4497 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 30 22:08:25.602628 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.602497 4497 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 30 22:08:25.602628 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.602504 4497 policy_none.go:50] "Start" Oct 30 22:08:25.602628 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.602516 4497 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 22:08:25.602628 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.602528 4497 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 22:08:25.602628 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.602544 4497 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:08:25.602834 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.602726 4497 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 30 22:08:25.602834 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.602737 4497 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 30 22:08:25.602834 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.602746 4497 policy_none.go:44] "Start" Oct 30 22:08:25.603480 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.603463 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientMemory" Oct 30 22:08:25.603551 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.603497 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Oct 30 22:08:25.603551 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.603513 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientPID" Oct 30 22:08:25.608084 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.608059 4497 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 22:08:25.611470 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.611456 4497 manager.go:341] "Starting Device Plugin manager" Oct 30 22:08:25.611553 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:25.611484 4497 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 22:08:25.611553 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.611496 4497 server.go:87] "Starting device plugin registration server" Oct 30 22:08:25.611779 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.611765 4497 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 22:08:25.611854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.611780 4497 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 22:08:25.611915 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.611861 4497 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 22:08:25.611988 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.611952 4497 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 22:08:25.612037 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.611994 4497 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 22:08:25.612037 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.611998 4497 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 22:08:25.612136 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.612047 4497 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T22:08:25.61198685Z","UUID":"7abfeb0f-b04a-4f0b-9b78-b3ec96324008","Handler":null,"Name":"","Endpoint":""} Oct 30 22:08:25.613295 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.613278 4497 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 22:08:25.613295 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.613296 4497 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 22:08:25.613574 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:25.613550 4497 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 22:08:25.613644 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:25.613591 4497 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-150.us-west-1.compute.internal\" not found" Oct 30 22:08:25.634696 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.634657 4497 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal"] Oct 30 22:08:25.634807 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.634794 4497 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:08:25.635760 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.635747 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientMemory" Oct 30 22:08:25.635835 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.635776 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Oct 30 22:08:25.635835 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.635790 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientPID" Oct 30 22:08:25.636077 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.636063 4497 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:08:25.636201 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.636188 4497 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:08:25.636946 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.636930 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientMemory" Oct 30 22:08:25.637006 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.636960 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Oct 30 22:08:25.637006 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.636972 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientPID" Oct 30 22:08:25.637059 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.636930 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientMemory" Oct 30 22:08:25.637059 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.637031 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Oct 30 22:08:25.637059 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.637045 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientPID" Oct 30 22:08:25.637171 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:25.637108 4497 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-150.us-west-1.compute.internal\" not found" node="ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:25.637297 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.637272 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" event={"ID":"a0c404c8d77f01c057faf5619397a983","Type":"ContainerStarted","Data":"66cb1413668a585c36d3b845605ae4a58677962ac5690c5cca50b4fce8fb0529"} Oct 30 22:08:25.637330 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.637305 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" event={"ID":"a0c404c8d77f01c057faf5619397a983","Type":"ContainerDied","Data":"0f948638a55df585021b8f29d3b7e041dd49c1f0d928b81ace7206f1f3aaea5f"} Oct 30 22:08:25.637330 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.637324 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" event={"ID":"a0c404c8d77f01c057faf5619397a983","Type":"ContainerStarted","Data":"88bd07b7953c3534d7040d3f704dc5f6e16fb63e7890cb224371eabb16a6c229"} Oct 30 22:08:25.637418 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.637392 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal" event={"ID":"b1d3741bfbe7d5cade012c8699af4bf8","Type":"ContainerStarted","Data":"2b6d5c9ebe1052f1296c45ab5ffaee607651a0b6bcf613cb9f874bee59dadb88"} Oct 30 22:08:25.637454 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.637415 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal" event={"ID":"b1d3741bfbe7d5cade012c8699af4bf8","Type":"ContainerStarted","Data":"2ba61a5f56077b56e059ca8a9d0da750142b5b5e02b3217f0bfe06c9f16ad059"} Oct 30 22:08:25.637454 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.637429 4497 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:08:25.638348 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.638333 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientMemory" Oct 30 22:08:25.638413 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.638355 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Oct 30 22:08:25.638413 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.638366 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientPID" Oct 30 22:08:25.638513 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:25.638502 4497 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-150.us-west-1.compute.internal\" not found" node="ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:25.687659 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.687639 4497 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 30 22:08:25.688195 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.688178 4497 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:08:25.688424 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.688411 4497 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:08:25.690116 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.690098 4497 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:08:25.698151 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.698134 4497 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:25.712367 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.712349 4497 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:08:25.713318 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.713300 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientMemory" Oct 30 22:08:25.713396 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.713325 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Oct 30 22:08:25.713396 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.713336 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeHasSufficientPID" Oct 30 22:08:25.713396 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.713374 4497 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:25.740728 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.740699 4497 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:08:25.775615 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.775593 4497 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 22:08:25.775692 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:25.775641 4497 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:25.775692 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.775651 4497 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:25.787921 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.787900 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a0c404c8d77f01c057faf5619397a983-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal\" (UID: \"a0c404c8d77f01c057faf5619397a983\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:25.788003 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.787924 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0c404c8d77f01c057faf5619397a983-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal\" (UID: \"a0c404c8d77f01c057faf5619397a983\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:25.788003 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.787941 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b1d3741bfbe7d5cade012c8699af4bf8-config\") pod \"kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal\" (UID: \"b1d3741bfbe7d5cade012c8699af4bf8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:25.850171 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.850124 4497 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 22:08:25.850171 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:25.850167 4497 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:25.850290 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.850185 4497 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:25.850290 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.850233 4497 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:25.850650 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.850635 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeNotReady" Oct 30 22:08:25.850696 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.850662 4497 setters.go:546] "Node became not ready" node="ip-10-0-129-150.us-west-1.compute.internal" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-10-30T22:08:25Z","lastTransitionTime":"2026-10-30T22:08:25Z","reason":"KubeletNotReady","message":"CSINode is not yet initialized"} Oct 30 22:08:25.861828 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.861800 4497 nodeinfomanager.go:471] existing CSINode "ip-10-0-129-150.us-west-1.compute.internal" is owned by different node (oldNodeID="8f4b5c82-fb2d-4153-b57e-e599d5fd25aa", newNodeID=""), cleaning up... Oct 30 22:08:25.888950 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.888921 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a0c404c8d77f01c057faf5619397a983-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal\" (UID: \"a0c404c8d77f01c057faf5619397a983\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:25.889039 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.888994 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a0c404c8d77f01c057faf5619397a983-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal\" (UID: \"a0c404c8d77f01c057faf5619397a983\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:25.889039 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.889007 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0c404c8d77f01c057faf5619397a983-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal\" (UID: \"a0c404c8d77f01c057faf5619397a983\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:25.889135 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.889038 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b1d3741bfbe7d5cade012c8699af4bf8-config\") pod \"kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal\" (UID: \"b1d3741bfbe7d5cade012c8699af4bf8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:25.889135 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.889074 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b1d3741bfbe7d5cade012c8699af4bf8-config\") pod \"kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal\" (UID: \"b1d3741bfbe7d5cade012c8699af4bf8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:25.889135 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:25.889105 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0c404c8d77f01c057faf5619397a983-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal\" (UID: \"a0c404c8d77f01c057faf5619397a983\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:26.478211 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.478175 4497 apiserver.go:52] "Watching apiserver" Oct 30 22:08:26.590523 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.590490 4497 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:26.590695 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.590622 4497 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:26.631763 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.631733 4497 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 22:08:26.632273 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.632252 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal","openshift-ovn-kubernetes/ovnkube-node-xwncm","openshift-insights/insights-runtime-extractor-nf65g","openshift-insights/periodic-gathering-zgdkz-zxwv9","openshift-kube-storage-version-migrator/migrator-66df5d496b-2rvfp","kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal","openshift-dns/node-resolver-pr5jx","openshift-ingress-canary/ingress-canary-btmts","openshift-dns/dns-default-hg5cf","openshift-multus/network-metrics-daemon-thzg4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp","openshift-multus/multus-gwx2d","openshift-network-diagnostics/network-check-target-chglk","openshift-network-operator/iptables-alerter-h5z4s","openshift-cluster-node-tuning-operator/tuned-69mlp","openshift-image-registry/node-ca-rfh52","openshift-multus/multus-additional-cni-plugins-xmvbh","kube-system/konnectivity-agent-cqphm","openshift-service-ca/service-ca-5fffc97bdf-fkhzw","kube-system/global-pull-secret-syncer-ztkhr"] Oct 30 22:08:26.634808 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.634786 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:26.636696 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.636678 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:26.640437 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.640418 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:26.659466 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.659442 4497 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 22:08:26.659550 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:26.659482 4497 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:26.661124 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.661110 4497 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 22:08:26.661172 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:26.661146 4497 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:08:26.687128 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.687107 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tmrfp\"" Oct 30 22:08:26.687426 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.687413 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-f5pfp\"" Oct 30 22:08:26.687475 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.687428 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 22:08:26.687932 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.687918 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 22:08:26.687968 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.687923 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 22:08:26.688139 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.688119 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-2djd4\"" Oct 30 22:08:26.688139 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.688121 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 22:08:26.688323 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.688175 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 22:08:26.688323 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.688193 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 22:08:26.688323 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.688226 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lmcdt\"" Oct 30 22:08:26.699443 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.699422 4497 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 22:08:26.787781 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.787690 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 22:08:26.787781 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.787736 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Oct 30 22:08:26.787781 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.787739 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 22:08:26.787942 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.787932 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 22:08:26.788121 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788102 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 22:08:26.788260 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788123 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 22:08:26.788260 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788153 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 22:08:26.788260 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788170 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 22:08:26.788260 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788183 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 22:08:26.788260 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788206 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 22:08:26.788260 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788231 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 22:08:26.788501 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788410 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 22:08:26.788501 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788483 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qzh2l\"" Oct 30 22:08:26.788501 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788483 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 22:08:26.788621 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788504 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 22:08:26.788621 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788559 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dlplv\"" Oct 30 22:08:26.788621 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788570 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 22:08:26.788621 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788590 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nff88\"" Oct 30 22:08:26.788749 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788628 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:08:26.788749 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788629 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Oct 30 22:08:26.788749 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788642 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Oct 30 22:08:26.788749 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788731 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 22:08:26.788881 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788852 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 22:08:26.788881 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788858 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 22:08:26.788964 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788893 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 22:08:26.788964 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788944 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 22:08:26.788964 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788949 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 22:08:26.789068 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788969 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 22:08:26.789068 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788971 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 22:08:26.789068 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.788999 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lds9w\"" Oct 30 22:08:26.789068 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.789004 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 22:08:26.789068 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.789016 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 22:08:26.789285 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.789136 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 22:08:26.789285 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.789139 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-c8f2h\"" Oct 30 22:08:26.789285 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.789153 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 22:08:26.789285 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.789160 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-kpsh7\"" Oct 30 22:08:26.789285 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.789162 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 22:08:26.789285 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.789186 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 30 22:08:26.789285 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.789188 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 30 22:08:26.789285 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.789211 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 22:08:26.789285 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.789213 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 22:08:26.789285 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.789231 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Oct 30 22:08:26.789285 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.789216 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 22:08:26.789607 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.789355 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jvf6k\"" Oct 30 22:08:26.789607 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.789404 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Oct 30 22:08:26.791786 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.791769 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:08:26.791860 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.791811 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2wgjn\"" Oct 30 22:08:26.791860 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.791820 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xjxjz\"" Oct 30 22:08:26.793917 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.793902 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-var-lib-cni-multus\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.793996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.793934 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f20cb0c1-6f52-41e1-978d-f59baf6bab48-konnectivity-ca\") pod \"konnectivity-agent-cqphm\" (UID: \"f20cb0c1-6f52-41e1-978d-f59baf6bab48\") " pod="kube-system/konnectivity-agent-cqphm" Oct 30 22:08:26.793996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.793958 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-sysctl-conf\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.793996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.793983 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85-hosts-file\") pod \"node-resolver-pr5jx\" (UID: \"fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85\") " pod="openshift-dns/node-resolver-pr5jx" Oct 30 22:08:26.794136 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794011 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7mkn\" (UniqueName: \"kubernetes.io/projected/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-api-access-m7mkn\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:26.794136 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794039 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn5dk\" (UniqueName: \"kubernetes.io/projected/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7-kube-api-access-sn5dk\") pod \"service-ca-5fffc97bdf-fkhzw\" (UID: \"ce692f4a-8f69-4923-bcb4-bb39a7cc5de7\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fkhzw" Oct 30 22:08:26.794136 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794063 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qhkv\" (UniqueName: \"kubernetes.io/projected/02b6cf19-863a-4c44-89e9-ccfd393bbf59-kube-api-access-8qhkv\") pod \"node-ca-rfh52\" (UID: \"02b6cf19-863a-4c44-89e9-ccfd393bbf59\") " pod="openshift-image-registry/node-ca-rfh52" Oct 30 22:08:26.794136 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794091 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.794136 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794121 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e456cbb1-7bc3-4d01-aea9-2af2c8addf39-cert\") pod \"ingress-canary-btmts\" (UID: \"e456cbb1-7bc3-4d01-aea9-2af2c8addf39\") " pod="openshift-ingress-canary/ingress-canary-btmts" Oct 30 22:08:26.794383 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794144 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-cnibin\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.794383 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794167 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8a728f8-1427-4a89-8102-6580684a157d-multus-daemon-config\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.794383 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794209 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-var-lib-openvswitch\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.794383 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794300 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9cc4dd2-875f-412d-bf36-880c5f383193-env-overrides\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.794383 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794333 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56mp6\" (UniqueName: \"kubernetes.io/projected/a70a380d-f1e4-4128-bb5c-db16f19662e6-kube-api-access-56mp6\") pod \"migrator-66df5d496b-2rvfp\" (UID: \"a70a380d-f1e4-4128-bb5c-db16f19662e6\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-2rvfp" Oct 30 22:08:26.794383 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794364 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lv7v\" (UniqueName: \"kubernetes.io/projected/d8a728f8-1427-4a89-8102-6580684a157d-kube-api-access-6lv7v\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.794640 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794398 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-run\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.794640 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794424 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-registration-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:08:26.794640 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794451 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01279335-4077-4099-85cb-ec0ed9925c7b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:08:26.794640 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794478 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9cc4dd2-875f-412d-bf36-880c5f383193-ovnkube-script-lib\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.794640 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794478 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e456cbb1-7bc3-4d01-aea9-2af2c8addf39-cert\") pod \"ingress-canary-btmts\" (UID: \"e456cbb1-7bc3-4d01-aea9-2af2c8addf39\") " pod="openshift-ingress-canary/ingress-canary-btmts" Oct 30 22:08:26.794640 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794500 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a0a698f-3051-4639-90c8-e4385348feea-tmp\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.794640 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794529 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9cc4dd2-875f-412d-bf36-880c5f383193-env-overrides\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.794640 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794538 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:08:26.794640 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794399 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f20cb0c1-6f52-41e1-978d-f59baf6bab48-konnectivity-ca\") pod \"konnectivity-agent-cqphm\" (UID: \"f20cb0c1-6f52-41e1-978d-f59baf6bab48\") " pod="kube-system/konnectivity-agent-cqphm" Oct 30 22:08:26.794640 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794567 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a0a698f-3051-4639-90c8-e4385348feea-tmp\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.794640 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794569 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8a728f8-1427-4a89-8102-6580684a157d-multus-daemon-config\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.794640 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794586 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs\") pod \"network-metrics-daemon-thzg4\" (UID: \"14afa5d3-bd87-4cb2-9c75-9059d4072250\") " pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:26.794640 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794618 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7-signing-cabundle\") pod \"service-ca-5fffc97bdf-fkhzw\" (UID: \"ce692f4a-8f69-4923-bcb4-bb39a7cc5de7\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fkhzw" Oct 30 22:08:26.795083 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794654 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-log-socket\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.795083 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794704 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmcxj\" (UniqueName: \"kubernetes.io/projected/84c4be79-ca4e-464e-9bfa-71c48c45b67d-kube-api-access-kmcxj\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:26.795083 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794746 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01279335-4077-4099-85cb-ec0ed9925c7b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:08:26.795083 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794753 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-lib-modules\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.795083 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794799 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-var-lib-kubelet\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.795083 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794825 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7-signing-cabundle\") pod \"service-ca-5fffc97bdf-fkhzw\" (UID: \"ce692f4a-8f69-4923-bcb4-bb39a7cc5de7\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fkhzw" Oct 30 22:08:26.795083 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794842 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5a0a698f-3051-4639-90c8-e4385348feea-etc-tuned\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.795083 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794876 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-etc-kubernetes\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.795083 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794892 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5a0a698f-3051-4639-90c8-e4385348feea-etc-tuned\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.795083 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794910 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfcs4\" (UniqueName: \"kubernetes.io/projected/e456cbb1-7bc3-4d01-aea9-2af2c8addf39-kube-api-access-rfcs4\") pod \"ingress-canary-btmts\" (UID: \"e456cbb1-7bc3-4d01-aea9-2af2c8addf39\") " pod="openshift-ingress-canary/ingress-canary-btmts" Oct 30 22:08:26.795083 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794953 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/d9695030-e34c-40b4-90d1-93cc907cd491-archives-path\") pod \"periodic-gathering-zgdkz-zxwv9\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:26.795083 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.794982 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-multus-cni-dir\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.795083 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795001 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/d9695030-e34c-40b4-90d1-93cc907cd491-archives-path\") pod \"periodic-gathering-zgdkz-zxwv9\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:26.795083 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795045 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-kubernetes\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.795602 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795087 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwpl5\" (UniqueName: \"kubernetes.io/projected/5a0a698f-3051-4639-90c8-e4385348feea-kube-api-access-kwpl5\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.795602 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795133 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-multus-socket-dir-parent\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.795602 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795223 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-var-lib-cni-bin\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.795602 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795293 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-var-lib-kubelet\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.795602 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795324 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-hostroot\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.795602 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795343 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-multus-conf-dir\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.795602 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795389 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f20cb0c1-6f52-41e1-978d-f59baf6bab48-agent-certs\") pod \"konnectivity-agent-cqphm\" (UID: \"f20cb0c1-6f52-41e1-978d-f59baf6bab48\") " pod="kube-system/konnectivity-agent-cqphm" Oct 30 22:08:26.795602 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795415 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-sys\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.795602 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795430 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a56c9584-f976-4ce6-a18a-946c6e24ff21-crio-socket\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:26.795602 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795449 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7-signing-key\") pod \"service-ca-5fffc97bdf-fkhzw\" (UID: \"ce692f4a-8f69-4923-bcb4-bb39a7cc5de7\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fkhzw" Oct 30 22:08:26.795602 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795474 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01279335-4077-4099-85cb-ec0ed9925c7b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:08:26.795602 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795577 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-run-netns\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.795602 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795604 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-etc-openvswitch\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.796062 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795637 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01279335-4077-4099-85cb-ec0ed9925c7b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:08:26.796062 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795653 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f20cb0c1-6f52-41e1-978d-f59baf6bab48-agent-certs\") pod \"konnectivity-agent-cqphm\" (UID: \"f20cb0c1-6f52-41e1-978d-f59baf6bab48\") " pod="kube-system/konnectivity-agent-cqphm" Oct 30 22:08:26.796062 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795653 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-node-log\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.796062 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795676 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7-signing-key\") pod \"service-ca-5fffc97bdf-fkhzw\" (UID: \"ce692f4a-8f69-4923-bcb4-bb39a7cc5de7\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fkhzw" Oct 30 22:08:26.796062 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795690 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9cc4dd2-875f-412d-bf36-880c5f383193-ovnkube-config\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.796062 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795711 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-dbus\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:26.796062 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795727 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9695030-e34c-40b4-90d1-93cc907cd491-trusted-ca-bundle\") pod \"periodic-gathering-zgdkz-zxwv9\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:26.796062 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795743 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-sysctl-d\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.796062 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795756 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-host\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.796062 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795773 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-socket-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:08:26.796062 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795816 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:26.796062 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795852 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9cc4dd2-875f-412d-bf36-880c5f383193-ovnkube-config\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.796062 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795854 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01279335-4077-4099-85cb-ec0ed9925c7b-system-cni-dir\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:08:26.796062 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795887 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01279335-4077-4099-85cb-ec0ed9925c7b-cnibin\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:08:26.796062 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795923 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-run-multus-certs\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.796062 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795980 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-kubelet-config\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:26.796062 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.795998 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-system-cni-dir\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.796062 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796030 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01279335-4077-4099-85cb-ec0ed9925c7b-cni-binary-copy\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796080 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7cws\" (UniqueName: \"kubernetes.io/projected/01279335-4077-4099-85cb-ec0ed9925c7b-kube-api-access-g7cws\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796115 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-cni-bin\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796193 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-cni-netd\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796227 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9cc4dd2-875f-412d-bf36-880c5f383193-ovn-node-metrics-cert\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796270 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9695030-e34c-40b4-90d1-93cc907cd491-service-ca-bundle\") pod \"periodic-gathering-zgdkz-zxwv9\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796296 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a56c9584-f976-4ce6-a18a-946c6e24ff21-data-volume\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796346 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01279335-4077-4099-85cb-ec0ed9925c7b-cni-binary-copy\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796357 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb1d231f-4920-49d0-bd0c-4a23690b2956-host-slash\") pod \"iptables-alerter-h5z4s\" (UID: \"bb1d231f-4920-49d0-bd0c-4a23690b2956\") " pod="openshift-network-operator/iptables-alerter-h5z4s" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796372 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a56c9584-f976-4ce6-a18a-946c6e24ff21-data-volume\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796413 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9695030-e34c-40b4-90d1-93cc907cd491-service-ca-bundle\") pod \"periodic-gathering-zgdkz-zxwv9\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796460 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/84c4be79-ca4e-464e-9bfa-71c48c45b67d-config-volume\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796478 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-device-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796506 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-sys-fs\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796512 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9cc4dd2-875f-412d-bf36-880c5f383193-ovn-node-metrics-cert\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796522 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8fmp\" (UniqueName: \"kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp\") pod \"network-check-target-chglk\" (UID: \"aec2e919-1d2a-4605-ba3b-d6f973ef036a\") " pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796539 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796567 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02b6cf19-863a-4c44-89e9-ccfd393bbf59-host\") pod \"node-ca-rfh52\" (UID: \"02b6cf19-863a-4c44-89e9-ccfd393bbf59\") " pod="openshift-image-registry/node-ca-rfh52" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796597 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01279335-4077-4099-85cb-ec0ed9925c7b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796622 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-kubelet\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796670 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/84c4be79-ca4e-464e-9bfa-71c48c45b67d-config-volume\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796664 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-systemd-units\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796700 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-run-k8s-cni-cncf-io\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796727 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85-tmp-dir\") pod \"node-resolver-pr5jx\" (UID: \"fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85\") " pod="openshift-dns/node-resolver-pr5jx" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796771 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796821 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrbdv\" (UniqueName: \"kubernetes.io/projected/14afa5d3-bd87-4cb2-9c75-9059d4072250-kube-api-access-qrbdv\") pod \"network-metrics-daemon-thzg4\" (UID: \"14afa5d3-bd87-4cb2-9c75-9059d4072250\") " pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:26.796830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796837 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85-tmp-dir\") pod \"node-resolver-pr5jx\" (UID: \"fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85\") " pod="openshift-dns/node-resolver-pr5jx" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796896 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8a728f8-1427-4a89-8102-6580684a157d-cni-binary-copy\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796924 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-run-netns\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796948 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-modprobe-d\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.796973 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46xsc\" (UniqueName: \"kubernetes.io/projected/bb1d231f-4920-49d0-bd0c-4a23690b2956-kube-api-access-46xsc\") pod \"iptables-alerter-h5z4s\" (UID: \"bb1d231f-4920-49d0-bd0c-4a23690b2956\") " pod="openshift-network-operator/iptables-alerter-h5z4s" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797003 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797032 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrm8z\" (UniqueName: \"kubernetes.io/projected/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-kube-api-access-zrm8z\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797062 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb1d231f-4920-49d0-bd0c-4a23690b2956-iptables-alerter-script\") pod \"iptables-alerter-h5z4s\" (UID: \"bb1d231f-4920-49d0-bd0c-4a23690b2956\") " pod="openshift-network-operator/iptables-alerter-h5z4s" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797088 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-run-systemd\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797107 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8a728f8-1427-4a89-8102-6580684a157d-cni-binary-copy\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797114 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lbss\" (UniqueName: \"kubernetes.io/projected/a9cc4dd2-875f-412d-bf36-880c5f383193-kube-api-access-8lbss\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797138 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84c4be79-ca4e-464e-9bfa-71c48c45b67d-tmp-dir\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797165 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02b6cf19-863a-4c44-89e9-ccfd393bbf59-serviceca\") pod \"node-ca-rfh52\" (UID: \"02b6cf19-863a-4c44-89e9-ccfd393bbf59\") " pod="openshift-image-registry/node-ca-rfh52" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797186 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-run-openvswitch\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797207 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84c4be79-ca4e-464e-9bfa-71c48c45b67d-tmp-dir\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797208 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-run-ovn\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797260 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-run-ovn-kubernetes\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797283 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kkxd\" (UniqueName: \"kubernetes.io/projected/d9695030-e34c-40b4-90d1-93cc907cd491-kube-api-access-7kkxd\") pod \"periodic-gathering-zgdkz-zxwv9\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797300 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797318 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-sysconfig\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797333 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-systemd\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797364 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb1d231f-4920-49d0-bd0c-4a23690b2956-iptables-alerter-script\") pod \"iptables-alerter-h5z4s\" (UID: \"bb1d231f-4920-49d0-bd0c-4a23690b2956\") " pod="openshift-network-operator/iptables-alerter-h5z4s" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797369 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdb9n\" (UniqueName: \"kubernetes.io/projected/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85-kube-api-access-rdb9n\") pod \"node-resolver-pr5jx\" (UID: \"fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85\") " pod="openshift-dns/node-resolver-pr5jx" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797408 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-slash\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797372 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02b6cf19-863a-4c44-89e9-ccfd393bbf59-serviceca\") pod \"node-ca-rfh52\" (UID: \"02b6cf19-863a-4c44-89e9-ccfd393bbf59\") " pod="openshift-image-registry/node-ca-rfh52" Oct 30 22:08:26.797761 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.797508 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-original-pull-secret\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:26.837103 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.837083 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 22:08:26.837183 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.837107 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-mmvq7\"" Oct 30 22:08:26.837294 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.837281 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-h8kpj\"" Oct 30 22:08:26.837538 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.837523 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-486qv\"" Oct 30 22:08:26.837719 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.837702 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 22:08:26.837790 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.837773 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-78xqf\"" Oct 30 22:08:26.837825 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.837777 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dl5xt\"" Oct 30 22:08:26.839119 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.839102 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Oct 30 22:08:26.845035 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.845021 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9cc4dd2-875f-412d-bf36-880c5f383193-ovnkube-script-lib\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.846224 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.846203 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9695030-e34c-40b4-90d1-93cc907cd491-trusted-ca-bundle\") pod \"periodic-gathering-zgdkz-zxwv9\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:26.854532 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.854514 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56mp6\" (UniqueName: \"kubernetes.io/projected/a70a380d-f1e4-4128-bb5c-db16f19662e6-kube-api-access-56mp6\") pod \"migrator-66df5d496b-2rvfp\" (UID: \"a70a380d-f1e4-4128-bb5c-db16f19662e6\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-2rvfp" Oct 30 22:08:26.854684 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.854665 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7mkn\" (UniqueName: \"kubernetes.io/projected/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-api-access-m7mkn\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:26.854736 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.854701 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qhkv\" (UniqueName: \"kubernetes.io/projected/02b6cf19-863a-4c44-89e9-ccfd393bbf59-kube-api-access-8qhkv\") pod \"node-ca-rfh52\" (UID: \"02b6cf19-863a-4c44-89e9-ccfd393bbf59\") " pod="openshift-image-registry/node-ca-rfh52" Oct 30 22:08:26.854890 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.854876 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwpl5\" (UniqueName: \"kubernetes.io/projected/5a0a698f-3051-4639-90c8-e4385348feea-kube-api-access-kwpl5\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.854977 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.854960 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn5dk\" (UniqueName: \"kubernetes.io/projected/ce692f4a-8f69-4923-bcb4-bb39a7cc5de7-kube-api-access-sn5dk\") pod \"service-ca-5fffc97bdf-fkhzw\" (UID: \"ce692f4a-8f69-4923-bcb4-bb39a7cc5de7\") " pod="openshift-service-ca/service-ca-5fffc97bdf-fkhzw" Oct 30 22:08:26.855185 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.855170 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lv7v\" (UniqueName: \"kubernetes.io/projected/d8a728f8-1427-4a89-8102-6580684a157d-kube-api-access-6lv7v\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.855319 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.855296 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmcxj\" (UniqueName: \"kubernetes.io/projected/84c4be79-ca4e-464e-9bfa-71c48c45b67d-kube-api-access-kmcxj\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:26.855417 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.855404 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfcs4\" (UniqueName: \"kubernetes.io/projected/e456cbb1-7bc3-4d01-aea9-2af2c8addf39-kube-api-access-rfcs4\") pod \"ingress-canary-btmts\" (UID: \"e456cbb1-7bc3-4d01-aea9-2af2c8addf39\") " pod="openshift-ingress-canary/ingress-canary-btmts" Oct 30 22:08:26.855695 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.855679 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7cws\" (UniqueName: \"kubernetes.io/projected/01279335-4077-4099-85cb-ec0ed9925c7b-kube-api-access-g7cws\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:08:26.856023 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.856009 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8fmp\" (UniqueName: \"kubernetes.io/projected/aec2e919-1d2a-4605-ba3b-d6f973ef036a-kube-api-access-s8fmp\") pod \"network-check-target-chglk\" (UID: \"aec2e919-1d2a-4605-ba3b-d6f973ef036a\") " pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:08:26.859704 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.859684 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrm8z\" (UniqueName: \"kubernetes.io/projected/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-kube-api-access-zrm8z\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:08:26.859936 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.859921 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrbdv\" (UniqueName: \"kubernetes.io/projected/14afa5d3-bd87-4cb2-9c75-9059d4072250-kube-api-access-qrbdv\") pod \"network-metrics-daemon-thzg4\" (UID: \"14afa5d3-bd87-4cb2-9c75-9059d4072250\") " pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:26.859979 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.859961 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46xsc\" (UniqueName: \"kubernetes.io/projected/bb1d231f-4920-49d0-bd0c-4a23690b2956-kube-api-access-46xsc\") pod \"iptables-alerter-h5z4s\" (UID: \"bb1d231f-4920-49d0-bd0c-4a23690b2956\") " pod="openshift-network-operator/iptables-alerter-h5z4s" Oct 30 22:08:26.860009 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.859960 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lbss\" (UniqueName: \"kubernetes.io/projected/a9cc4dd2-875f-412d-bf36-880c5f383193-kube-api-access-8lbss\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.860425 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.860405 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdb9n\" (UniqueName: \"kubernetes.io/projected/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85-kube-api-access-rdb9n\") pod \"node-resolver-pr5jx\" (UID: \"fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85\") " pod="openshift-dns/node-resolver-pr5jx" Oct 30 22:08:26.860598 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.860573 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kkxd\" (UniqueName: \"kubernetes.io/projected/d9695030-e34c-40b4-90d1-93cc907cd491-kube-api-access-7kkxd\") pod \"periodic-gathering-zgdkz-zxwv9\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:08:26.898630 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898614 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:08:26.898702 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898637 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-run-systemd\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.898702 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898653 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-run-openvswitch\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.898702 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898669 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-run-ovn\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.898702 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898691 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-run-ovn-kubernetes\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.898876 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898717 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-sysconfig\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.898876 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898723 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:08:26.898876 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898730 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-run-ovn\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.898876 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898726 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-run-openvswitch\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.898876 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898741 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-systemd\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.898876 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898727 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-run-systemd\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.898876 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898765 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-run-ovn-kubernetes\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.898876 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898779 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-sysconfig\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.898876 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898785 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-systemd\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.898876 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898795 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-slash\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.898876 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898817 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-var-lib-cni-multus\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.898876 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898845 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-sysctl-conf\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.898876 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898859 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-slash\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.898876 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898866 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85-hosts-file\") pod \"node-resolver-pr5jx\" (UID: \"fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85\") " pod="openshift-dns/node-resolver-pr5jx" Oct 30 22:08:26.898876 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898879 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-var-lib-cni-multus\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898907 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898932 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898933 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-cnibin\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898952 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-sysctl-conf\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898952 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-var-lib-openvswitch\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898913 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85-hosts-file\") pod \"node-resolver-pr5jx\" (UID: \"fc8c5ac0-1a8f-4a7d-bb63-65d5f6119c85\") " pod="openshift-dns/node-resolver-pr5jx" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898971 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-var-lib-openvswitch\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898964 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-cnibin\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.898986 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-run\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899008 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-registration-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899017 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-run\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899028 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899043 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs\") pod \"network-metrics-daemon-thzg4\" (UID: \"14afa5d3-bd87-4cb2-9c75-9059d4072250\") " pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899057 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-log-socket\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899066 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-registration-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899070 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-lib-modules\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899090 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-log-socket\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899102 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899114 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-var-lib-kubelet\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:26.899136 4497 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899143 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-var-lib-kubelet\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899149 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-etc-kubernetes\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899180 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-multus-cni-dir\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899203 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-kubernetes\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:26.899220 4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs podName:14afa5d3-bd87-4cb2-9c75-9059d4072250 nodeName:}" failed. No retries permitted until 2026-10-30 22:08:27.399199227 +0000 UTC m=+2.026264778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs") pod "network-metrics-daemon-thzg4" (UID: "14afa5d3-bd87-4cb2-9c75-9059d4072250") : secret "metrics-daemon-secret" not found Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899254 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-lib-modules\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899267 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-kubernetes\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.899478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899486 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-etc-kubernetes\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899530 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-multus-socket-dir-parent\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899265 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-multus-socket-dir-parent\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899560 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-multus-cni-dir\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899594 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-var-lib-cni-bin\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899621 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-var-lib-kubelet\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899642 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-hostroot\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899672 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-multus-conf-dir\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899700 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-var-lib-cni-bin\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899713 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-var-lib-kubelet\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899704 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-sys\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899748 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-sys\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899752 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-hostroot\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899773 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a56c9584-f976-4ce6-a18a-946c6e24ff21-crio-socket\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899795 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-multus-conf-dir\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899845 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a56c9584-f976-4ce6-a18a-946c6e24ff21-crio-socket\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899946 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-run-netns\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899976 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-etc-openvswitch\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.899995 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-node-log\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900022 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-dbus\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900050 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-etc-openvswitch\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900054 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-sysctl-d\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900082 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-host\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900233 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-sysctl-d\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900294 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-socket-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900298 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-run-netns\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900348 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900349 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-node-log\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900395 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01279335-4077-4099-85cb-ec0ed9925c7b-system-cni-dir\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900445 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01279335-4077-4099-85cb-ec0ed9925c7b-cnibin\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900447 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-host\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900477 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-run-multus-certs\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900400 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-dbus\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900525 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-kubelet-config\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900570 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01279335-4077-4099-85cb-ec0ed9925c7b-system-cni-dir\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900616 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01279335-4077-4099-85cb-ec0ed9925c7b-cnibin\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900622 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-run-multus-certs\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900557 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-system-cni-dir\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900669 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-system-cni-dir\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900679 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-cni-bin\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900713 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-cni-netd\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.900732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900759 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb1d231f-4920-49d0-bd0c-4a23690b2956-host-slash\") pod \"iptables-alerter-h5z4s\" (UID: \"bb1d231f-4920-49d0-bd0c-4a23690b2956\") " pod="openshift-network-operator/iptables-alerter-h5z4s" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900768 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-cni-bin\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900729 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be-kubelet-config\") pod \"global-pull-secret-syncer-ztkhr\" (UID: \"1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be\") " pod="kube-system/global-pull-secret-syncer-ztkhr" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900809 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-device-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900829 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-cni-netd\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900841 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-sys-fs\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900875 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb1d231f-4920-49d0-bd0c-4a23690b2956-host-slash\") pod \"iptables-alerter-h5z4s\" (UID: \"bb1d231f-4920-49d0-bd0c-4a23690b2956\") " pod="openshift-network-operator/iptables-alerter-h5z4s" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900888 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900916 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02b6cf19-863a-4c44-89e9-ccfd393bbf59-host\") pod \"node-ca-rfh52\" (UID: \"02b6cf19-863a-4c44-89e9-ccfd393bbf59\") " pod="openshift-image-registry/node-ca-rfh52" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900928 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-device-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900994 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-sys-fs\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.900994 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a56c9584-f976-4ce6-a18a-946c6e24ff21-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.901039 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be4e3e6b-42e3-4ebd-ac88-8b45ab253747-socket-dir\") pod \"aws-ebs-csi-driver-node-h8kdp\" (UID: \"be4e3e6b-42e3-4ebd-ac88-8b45ab253747\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8kdp" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.901044 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02b6cf19-863a-4c44-89e9-ccfd393bbf59-host\") pod \"node-ca-rfh52\" (UID: \"02b6cf19-863a-4c44-89e9-ccfd393bbf59\") " pod="openshift-image-registry/node-ca-rfh52" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.901079 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01279335-4077-4099-85cb-ec0ed9925c7b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.901125 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-kubelet\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.901149 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-systemd-units\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:26.901166 4497 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.901181 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-run-k8s-cni-cncf-io\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:26.901254 4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls podName:a56c9584-f976-4ce6-a18a-946c6e24ff21 nodeName:}" failed. No retries permitted until 2026-10-30 22:08:27.40121735 +0000 UTC m=+2.028282893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nf65g" (UID: "a56c9584-f976-4ce6-a18a-946c6e24ff21") : secret "insights-runtime-extractor-tls" not found Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.901282 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.901304 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-run-k8s-cni-cncf-io\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.901313 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-run-netns\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.901385 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01279335-4077-4099-85cb-ec0ed9925c7b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xmvbh\" (UID: \"01279335-4077-4099-85cb-ec0ed9925c7b\") " pod="openshift-multus/multus-additional-cni-plugins-xmvbh" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:26.901403 4497 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:26.901445 4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls podName:84c4be79-ca4e-464e-9bfa-71c48c45b67d nodeName:}" failed. No retries permitted until 2026-10-30 22:08:27.401426479 +0000 UTC m=+2.028492039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls") pod "dns-default-hg5cf" (UID: "84c4be79-ca4e-464e-9bfa-71c48c45b67d") : secret "dns-default-metrics-tls" not found Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.901449 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8a728f8-1427-4a89-8102-6580684a157d-host-run-netns\") pod \"multus-gwx2d\" (UID: \"d8a728f8-1427-4a89-8102-6580684a157d\") " pod="openshift-multus/multus-gwx2d" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.901500 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-systemd-units\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.901503 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9cc4dd2-875f-412d-bf36-880c5f383193-host-kubelet\") pod \"ovnkube-node-xwncm\" (UID: \"a9cc4dd2-875f-412d-bf36-880c5f383193\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.901539 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-modprobe-d\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.902402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.901689 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5a0a698f-3051-4639-90c8-e4385348feea-etc-modprobe-d\") pod \"tuned-69mlp\" (UID: \"5a0a698f-3051-4639-90c8-e4385348feea\") " pod="openshift-cluster-node-tuning-operator/tuned-69mlp" Oct 30 22:08:26.943225 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:26.943210 4497 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:08:27.353062 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:27.352993 4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rfh52_02b6cf19-863a-4c44-89e9-ccfd393bbf59/node-ca/0.log" Oct 30 22:08:27.405980 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:27.405949 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs\") pod \"network-metrics-daemon-thzg4\" (UID: \"14afa5d3-bd87-4cb2-9c75-9059d4072250\") " pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:27.406119 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:27.405994 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:27.406119 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:27.406011 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:27.406119 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:27.406098 4497 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:08:27.406119 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:27.406099 4497 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 22:08:27.406119 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:27.406116 4497 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:08:27.406316 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:27.406157 4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls podName:84c4be79-ca4e-464e-9bfa-71c48c45b67d nodeName:}" failed. No retries permitted until 2026-10-30 22:08:28.406137683 +0000 UTC m=+3.033203211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls") pod "dns-default-hg5cf" (UID: "84c4be79-ca4e-464e-9bfa-71c48c45b67d") : secret "dns-default-metrics-tls" not found Oct 30 22:08:27.406316 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:27.406169 4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs podName:14afa5d3-bd87-4cb2-9c75-9059d4072250 nodeName:}" failed. No retries permitted until 2026-10-30 22:08:28.406163704 +0000 UTC m=+3.033229231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs") pod "network-metrics-daemon-thzg4" (UID: "14afa5d3-bd87-4cb2-9c75-9059d4072250") : secret "metrics-daemon-secret" not found Oct 30 22:08:27.406316 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:27.406180 4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls podName:a56c9584-f976-4ce6-a18a-946c6e24ff21 nodeName:}" failed. No retries permitted until 2026-10-30 22:08:28.406173333 +0000 UTC m=+3.033238861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nf65g" (UID: "a56c9584-f976-4ce6-a18a-946c6e24ff21") : secret "insights-runtime-extractor-tls" not found Oct 30 22:08:27.753291 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:27.753258 4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-btmts_e456cbb1-7bc3-4d01-aea9-2af2c8addf39/serve-healthcheck-canary/0.log" Oct 30 22:08:28.153551 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:28.153518 4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-2rvfp_a70a380d-f1e4-4128-bb5c-db16f19662e6/migrator/0.log" Oct 30 22:08:28.411814 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:28.411787 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs\") pod \"network-metrics-daemon-thzg4\" (UID: \"14afa5d3-bd87-4cb2-9c75-9059d4072250\") " pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:28.411965 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:28.411832 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:28.411965 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:28.411856 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:28.411965 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:28.411930 4497 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 22:08:28.411965 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:28.411933 4497 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:08:28.411965 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:28.411933 4497 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:08:28.412124 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:28.411984 4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls podName:84c4be79-ca4e-464e-9bfa-71c48c45b67d nodeName:}" failed. No retries permitted until 2026-10-30 22:08:30.411971502 +0000 UTC m=+5.039037043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls") pod "dns-default-hg5cf" (UID: "84c4be79-ca4e-464e-9bfa-71c48c45b67d") : secret "dns-default-metrics-tls" not found Oct 30 22:08:28.412124 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:28.412002 4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls podName:a56c9584-f976-4ce6-a18a-946c6e24ff21 nodeName:}" failed. No retries permitted until 2026-10-30 22:08:30.411989622 +0000 UTC m=+5.039055177 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nf65g" (UID: "a56c9584-f976-4ce6-a18a-946c6e24ff21") : secret "insights-runtime-extractor-tls" not found Oct 30 22:08:28.412124 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:28.412014 4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs podName:14afa5d3-bd87-4cb2-9c75-9059d4072250 nodeName:}" failed. No retries permitted until 2026-10-30 22:08:30.412008756 +0000 UTC m=+5.039074283 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs") pod "network-metrics-daemon-thzg4" (UID: "14afa5d3-bd87-4cb2-9c75-9059d4072250") : secret "metrics-daemon-secret" not found Oct 30 22:08:28.596154 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:28.596124 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-fkhzw" event={"ID":"ce692f4a-8f69-4923-bcb4-bb39a7cc5de7","Type":"ContainerStarted","Data":"fe1dc6772951945d638d50b3cc8aa2edbbaebe9e5884eced85edb3177eb02c64"} Oct 30 22:08:29.339708 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:29.339655 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:29.372823 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:29.372800 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:29.653947 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:29.653912 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:29.913077 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:29.913008 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:30.191613 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:30.191545 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:30.424608 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:30.424576 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs\") pod \"network-metrics-daemon-thzg4\" (UID: \"14afa5d3-bd87-4cb2-9c75-9059d4072250\") " pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:30.425019 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:30.424623 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:30.425019 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:30.424659 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:30.425019 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:30.424775 4497 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:08:30.425019 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:30.424911 4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls podName:84c4be79-ca4e-464e-9bfa-71c48c45b67d nodeName:}" failed. No retries permitted until 2026-10-30 22:08:34.424889015 +0000 UTC m=+9.051954549 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls") pod "dns-default-hg5cf" (UID: "84c4be79-ca4e-464e-9bfa-71c48c45b67d") : secret "dns-default-metrics-tls" not found Oct 30 22:08:30.425174 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:30.425030 4497 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 22:08:30.427757 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:30.427722 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14afa5d3-bd87-4cb2-9c75-9059d4072250-metrics-certs\") pod \"network-metrics-daemon-thzg4\" (UID: \"14afa5d3-bd87-4cb2-9c75-9059d4072250\") " pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:30.427892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:30.427722 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a56c9584-f976-4ce6-a18a-946c6e24ff21-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nf65g\" (UID: \"a56c9584-f976-4ce6-a18a-946c6e24ff21\") " pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:30.535285 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:30.535201 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thzg4" Oct 30 22:08:30.540832 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:30.540813 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nf65g" Oct 30 22:08:30.911284 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:30.911189 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-thzg4"] Oct 30 22:08:30.950529 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:30.950503 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14afa5d3_bd87_4cb2_9c75_9059d4072250.slice/crio-de084d47b006779a7e1384c482b799d51bd8b2b14af6db6682059e181b487f2e WatchSource:0}: Error finding container de084d47b006779a7e1384c482b799d51bd8b2b14af6db6682059e181b487f2e: Status 404 returned error can't find the container with id de084d47b006779a7e1384c482b799d51bd8b2b14af6db6682059e181b487f2e Oct 30 22:08:30.959400 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:30.959384 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:08:30.962185 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:30.962163 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nf65g"] Oct 30 22:08:30.964143 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:30.964121 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:30.965500 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:30.965478 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda56c9584_f976_4ce6_a18a_946c6e24ff21.slice/crio-4498ba4855eb1ca7bd783c6cc2f61bc694a617a209b66a9264fb7619142ec137 WatchSource:0}: Error finding container 4498ba4855eb1ca7bd783c6cc2f61bc694a617a209b66a9264fb7619142ec137: Status 404 returned error can't find the container with id 4498ba4855eb1ca7bd783c6cc2f61bc694a617a209b66a9264fb7619142ec137 Oct 30 22:08:31.386455 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:31.386421 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:31.606024 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:31.605994 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nf65g" event={"ID":"a56c9584-f976-4ce6-a18a-946c6e24ff21","Type":"ContainerStarted","Data":"1756a9e305bc324825a38fd448eb036c4e5fa0bc66202bad9f1750f7934aea78"} Oct 30 22:08:31.606455 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:31.606056 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nf65g" event={"ID":"a56c9584-f976-4ce6-a18a-946c6e24ff21","Type":"ContainerStarted","Data":"4498ba4855eb1ca7bd783c6cc2f61bc694a617a209b66a9264fb7619142ec137"} Oct 30 22:08:31.607220 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:31.607197 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-thzg4" event={"ID":"14afa5d3-bd87-4cb2-9c75-9059d4072250","Type":"ContainerStarted","Data":"de084d47b006779a7e1384c482b799d51bd8b2b14af6db6682059e181b487f2e"} Oct 30 22:08:31.698508 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:31.698448 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:31.956267 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:31.956157 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:32.312408 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:32.312384 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:32.614590 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:32.614557 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nf65g" event={"ID":"a56c9584-f976-4ce6-a18a-946c6e24ff21","Type":"ContainerStarted","Data":"06de9293d43c4eb536da44080efd5e2b93dd8a687c28276b0f856175e31d3de6"} Oct 30 22:08:32.616322 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:32.616292 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-thzg4" event={"ID":"14afa5d3-bd87-4cb2-9c75-9059d4072250","Type":"ContainerStarted","Data":"f438c1f7b052b53217e5ee8d5ccab06e62817f7bbd323833e5c01367fede0a7a"} Oct 30 22:08:32.616446 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:32.616343 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-thzg4" event={"ID":"14afa5d3-bd87-4cb2-9c75-9059d4072250","Type":"ContainerStarted","Data":"7733cc8dd6766c344bf9dbf78356174e9a57842e7c13f8e70161387e38d99da5"} Oct 30 22:08:32.975899 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:32.975862 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:33.375166 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:33.375094 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:33.664655 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:33.664582 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:33.737704 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:33.737680 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:33.737919 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:33.737903 4497 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 22:08:33.930830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:33.930759 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:34.201566 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:34.201512 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:34.451276 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:34.451230 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:34.453580 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:34.453541 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84c4be79-ca4e-464e-9bfa-71c48c45b67d-metrics-tls\") pod \"dns-default-hg5cf\" (UID: \"84c4be79-ca4e-464e-9bfa-71c48c45b67d\") " pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:34.625774 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:34.625745 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nf65g" event={"ID":"a56c9584-f976-4ce6-a18a-946c6e24ff21","Type":"ContainerStarted","Data":"6da058484e89a5706f0ced3cc2f78806c3c4c3cd5b966f959a364afb46874f12"} Oct 30 22:08:34.737333 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:34.737272 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:34.962098 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:34.962070 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:35.108772 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:35.108604 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hg5cf"] Oct 30 22:08:35.112894 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:35.112871 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c4be79_ca4e_464e_9bfa_71c48c45b67d.slice/crio-52dda3b37568df160116bc55dd189c197e86a569391572ff0532b07090a1d4ec WatchSource:0}: Error finding container 52dda3b37568df160116bc55dd189c197e86a569391572ff0532b07090a1d4ec: Status 404 returned error can't find the container with id 52dda3b37568df160116bc55dd189c197e86a569391572ff0532b07090a1d4ec Oct 30 22:08:35.240798 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:35.240763 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:35.251813 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:35.251783 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xwncm" Oct 30 22:08:35.504628 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:35.504597 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:35.573751 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:35.573719 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cqphm" Oct 30 22:08:35.629545 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:35.629512 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hg5cf" event={"ID":"84c4be79-ca4e-464e-9bfa-71c48c45b67d","Type":"ContainerStarted","Data":"52dda3b37568df160116bc55dd189c197e86a569391572ff0532b07090a1d4ec"} Oct 30 22:08:35.804698 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:35.804627 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:36.098908 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:36.098819 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:36.155642 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:36.155618 4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-129-150.us-west-1.compute.internal" event="NodeReady" Oct 30 22:08:36.573511 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:36.573471 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:36.852831 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:36.852750 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:37.113620 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:37.113541 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:37.378664 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:37.378636 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:37.639953 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:37.639880 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hg5cf" event={"ID":"84c4be79-ca4e-464e-9bfa-71c48c45b67d","Type":"ContainerStarted","Data":"3d8374e67961703c541d6c6a15264a4e4e64d18a02a8801d992097c58e3e089d"} Oct 30 22:08:37.639953 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:37.639937 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hg5cf" event={"ID":"84c4be79-ca4e-464e-9bfa-71c48c45b67d","Type":"ContainerStarted","Data":"40e43d58d254145c559161bd86456d102a6c5411f0228586c2b4ef1fa7ed24f2"} Oct 30 22:08:37.640153 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:37.640017 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:37.772477 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:37.772452 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:38.591133 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:38.591097 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:38.966508 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:38.966475 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:39.287867 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:39.287797 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:39.558760 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:39.558690 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:39.852825 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:39.852755 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:40.206341 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:40.206314 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:40.472345 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:40.472285 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:40.934895 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:40.934864 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:43.389134 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.389104 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6bgp8"] Oct 30 22:08:43.390955 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.390937 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6bgp8" Oct 30 22:08:43.414099 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.414078 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b05c998f-4a64-44b5-85b6-490fdc1ce6c5-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-6bgp8\" (UID: \"b05c998f-4a64-44b5-85b6-490fdc1ce6c5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6bgp8" Oct 30 22:08:43.494728 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.494696 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Oct 30 22:08:43.494829 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.494742 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4fncz\"" Oct 30 22:08:43.495352 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.495315 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6bgp8"] Oct 30 22:08:43.514956 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.514933 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b05c998f-4a64-44b5-85b6-490fdc1ce6c5-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-6bgp8\" (UID: \"b05c998f-4a64-44b5-85b6-490fdc1ce6c5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6bgp8" Oct 30 22:08:43.517379 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.517351 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b05c998f-4a64-44b5-85b6-490fdc1ce6c5-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-6bgp8\" (UID: \"b05c998f-4a64-44b5-85b6-490fdc1ce6c5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6bgp8" Oct 30 22:08:43.527268 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.527229 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d58b598bd-pscfp"] Oct 30 22:08:43.528841 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.528826 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.616027 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.616003 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5da6b4be-3e26-4d60-b3af-f8665a450d40-registry-certificates\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.616152 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.616031 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5da6b4be-3e26-4d60-b3af-f8665a450d40-installation-pull-secrets\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.616152 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.616058 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5da6b4be-3e26-4d60-b3af-f8665a450d40-registry-tls\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.616152 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.616114 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5da6b4be-3e26-4d60-b3af-f8665a450d40-image-registry-private-configuration\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.616152 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.616144 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9mts\" (UniqueName: \"kubernetes.io/projected/5da6b4be-3e26-4d60-b3af-f8665a450d40-kube-api-access-c9mts\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.616327 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.616218 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5da6b4be-3e26-4d60-b3af-f8665a450d40-trusted-ca\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.616327 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.616304 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5da6b4be-3e26-4d60-b3af-f8665a450d40-ca-trust-extracted\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.616394 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.616329 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5da6b4be-3e26-4d60-b3af-f8665a450d40-bound-sa-token\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.638121 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.638096 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Oct 30 22:08:43.638228 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.638153 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s8t4z\"" Oct 30 22:08:43.638307 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.638253 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Oct 30 22:08:43.638307 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.638256 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Oct 30 22:08:43.638307 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.638230 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Oct 30 22:08:43.639025 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.639008 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d58b598bd-pscfp"] Oct 30 22:08:43.701554 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.701489 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6bgp8" Oct 30 22:08:43.717256 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.717218 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9mts\" (UniqueName: \"kubernetes.io/projected/5da6b4be-3e26-4d60-b3af-f8665a450d40-kube-api-access-c9mts\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.717355 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.717267 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5da6b4be-3e26-4d60-b3af-f8665a450d40-trusted-ca\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.717355 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.717287 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5da6b4be-3e26-4d60-b3af-f8665a450d40-ca-trust-extracted\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.717355 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.717301 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5da6b4be-3e26-4d60-b3af-f8665a450d40-bound-sa-token\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.717470 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.717379 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5da6b4be-3e26-4d60-b3af-f8665a450d40-registry-certificates\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.717470 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.717410 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5da6b4be-3e26-4d60-b3af-f8665a450d40-installation-pull-secrets\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.717470 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.717457 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5da6b4be-3e26-4d60-b3af-f8665a450d40-registry-tls\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.717571 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.717494 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5da6b4be-3e26-4d60-b3af-f8665a450d40-image-registry-private-configuration\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.717879 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.717855 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5da6b4be-3e26-4d60-b3af-f8665a450d40-ca-trust-extracted\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.718544 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.718523 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5da6b4be-3e26-4d60-b3af-f8665a450d40-trusted-ca\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.718628 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.718579 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5da6b4be-3e26-4d60-b3af-f8665a450d40-registry-certificates\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.720091 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.720070 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5da6b4be-3e26-4d60-b3af-f8665a450d40-installation-pull-secrets\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.720675 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.720655 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5da6b4be-3e26-4d60-b3af-f8665a450d40-registry-tls\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.720747 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.720672 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5da6b4be-3e26-4d60-b3af-f8665a450d40-image-registry-private-configuration\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.755994 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.755958 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:43.779116 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.779087 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5da6b4be-3e26-4d60-b3af-f8665a450d40-bound-sa-token\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.779377 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.779358 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9mts\" (UniqueName: \"kubernetes.io/projected/5da6b4be-3e26-4d60-b3af-f8665a450d40-kube-api-access-c9mts\") pod \"image-registry-6d58b598bd-pscfp\" (UID: \"5da6b4be-3e26-4d60-b3af-f8665a450d40\") " pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:43.838538 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:43.838511 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:44.027947 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:44.027891 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:44.067676 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:44.067654 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6bgp8"] Oct 30 22:08:44.070640 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:44.070611 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb05c998f_4a64_44b5_85b6_490fdc1ce6c5.slice/crio-13205c89d4ed8565d0b3c6838a3a174b71bb456465deede6757e16566c5200c1 WatchSource:0}: Error finding container 13205c89d4ed8565d0b3c6838a3a174b71bb456465deede6757e16566c5200c1: Status 404 returned error can't find the container with id 13205c89d4ed8565d0b3c6838a3a174b71bb456465deede6757e16566c5200c1 Oct 30 22:08:44.207875 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:44.207852 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d58b598bd-pscfp"] Oct 30 22:08:44.210605 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:44.210580 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5da6b4be_3e26_4d60_b3af_f8665a450d40.slice/crio-04f5ae412e089848a65b2b7a050bf1f3510e34bbb8e5f6cba257d95cfcfdc7be WatchSource:0}: Error finding container 04f5ae412e089848a65b2b7a050bf1f3510e34bbb8e5f6cba257d95cfcfdc7be: Status 404 returned error can't find the container with id 04f5ae412e089848a65b2b7a050bf1f3510e34bbb8e5f6cba257d95cfcfdc7be Oct 30 22:08:44.301183 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:44.301127 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:44.660811 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:44.660774 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6bgp8" event={"ID":"b05c998f-4a64-44b5-85b6-490fdc1ce6c5","Type":"ContainerStarted","Data":"13205c89d4ed8565d0b3c6838a3a174b71bb456465deede6757e16566c5200c1"} Oct 30 22:08:44.662209 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:44.662179 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" event={"ID":"5da6b4be-3e26-4d60-b3af-f8665a450d40","Type":"ContainerStarted","Data":"baee1afb1d1c596f12df707aab842f4d55768723b04006d7bd997a28e2884431"} Oct 30 22:08:44.662361 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:44.662224 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" event={"ID":"5da6b4be-3e26-4d60-b3af-f8665a450d40","Type":"ContainerStarted","Data":"04f5ae412e089848a65b2b7a050bf1f3510e34bbb8e5f6cba257d95cfcfdc7be"} Oct 30 22:08:44.786174 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:44.786130 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" podStartSLOduration=1.786117379 podStartE2EDuration="1.786117379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:44.785756194 +0000 UTC m=+19.412821745" watchObservedRunningTime="2026-10-30 22:08:44.786117379 +0000 UTC m=+19.413182925" Oct 30 22:08:44.845986 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:44.845962 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:45.127693 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:45.127646 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:45.667111 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:45.667033 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6bgp8" event={"ID":"b05c998f-4a64-44b5-85b6-490fdc1ce6c5","Type":"ContainerStarted","Data":"c0619562ff78ca9a86872821e8aaf0b4425eec33544cf22dcf9fa28a31796475"} Oct 30 22:08:45.667564 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:45.667330 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:08:45.667564 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:45.667381 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6bgp8" Oct 30 22:08:45.671649 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:45.671628 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6bgp8" Oct 30 22:08:45.782750 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:45.782698 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6bgp8" podStartSLOduration=1.4568347720000001 podStartE2EDuration="2.782684847s" totalImagesPullingTime="1.325850075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:45.782084338 +0000 UTC m=+20.409149888" watchObservedRunningTime="2026-10-30 22:08:45.782684847 +0000 UTC m=+20.409750399" Oct 30 22:08:47.053954 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:47.053907 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:47.359642 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:47.359561 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:47.645407 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:47.645384 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hg5cf" Oct 30 22:08:47.658379 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:47.658353 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:52.558278 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:52.558225 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:52.851315 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:52.851175 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:53.120335 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.120265 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-brbdv"] Oct 30 22:08:53.122812 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.122796 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.152331 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.152303 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:53.175482 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.175464 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f8697db-185a-496e-a21a-2d56e33297b9-node-exporter-tls\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.175595 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.175489 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f8697db-185a-496e-a21a-2d56e33297b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.175595 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.175514 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f8697db-185a-496e-a21a-2d56e33297b9-node-exporter-wtmp\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.175710 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.175590 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfkp7\" (UniqueName: \"kubernetes.io/projected/6f8697db-185a-496e-a21a-2d56e33297b9-kube-api-access-lfkp7\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.175784 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.175765 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f8697db-185a-496e-a21a-2d56e33297b9-root\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.175872 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.175824 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f8697db-185a-496e-a21a-2d56e33297b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.175872 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.175861 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f8697db-185a-496e-a21a-2d56e33297b9-metrics-client-ca\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.175947 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.175887 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f8697db-185a-496e-a21a-2d56e33297b9-sys\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.175947 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.175926 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f8697db-185a-496e-a21a-2d56e33297b9-node-exporter-textfile\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.225737 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.225713 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sjbnz\"" Oct 30 22:08:53.225853 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.225715 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 30 22:08:53.225853 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.225741 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 30 22:08:53.225853 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.225746 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 22:08:53.225853 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.225749 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 22:08:53.225853 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.225825 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 30 22:08:53.226032 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.225863 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 30 22:08:53.276635 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.276608 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f8697db-185a-496e-a21a-2d56e33297b9-metrics-client-ca\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.276635 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.276635 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f8697db-185a-496e-a21a-2d56e33297b9-sys\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.276795 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.276668 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f8697db-185a-496e-a21a-2d56e33297b9-node-exporter-textfile\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.276795 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.276702 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f8697db-185a-496e-a21a-2d56e33297b9-node-exporter-tls\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.276795 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.276729 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f8697db-185a-496e-a21a-2d56e33297b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.276795 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.276741 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f8697db-185a-496e-a21a-2d56e33297b9-sys\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.276795 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.276756 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f8697db-185a-496e-a21a-2d56e33297b9-node-exporter-wtmp\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.277039 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.276805 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfkp7\" (UniqueName: \"kubernetes.io/projected/6f8697db-185a-496e-a21a-2d56e33297b9-kube-api-access-lfkp7\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.277039 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.276848 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f8697db-185a-496e-a21a-2d56e33297b9-root\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.277039 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.276861 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f8697db-185a-496e-a21a-2d56e33297b9-node-exporter-wtmp\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.277039 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.276888 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f8697db-185a-496e-a21a-2d56e33297b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.277039 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.276971 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f8697db-185a-496e-a21a-2d56e33297b9-root\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.277314 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.277224 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f8697db-185a-496e-a21a-2d56e33297b9-node-exporter-textfile\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.277370 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.277347 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f8697db-185a-496e-a21a-2d56e33297b9-metrics-client-ca\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.277424 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.277406 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f8697db-185a-496e-a21a-2d56e33297b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.279298 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.279280 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f8697db-185a-496e-a21a-2d56e33297b9-node-exporter-tls\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.279380 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.279306 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f8697db-185a-496e-a21a-2d56e33297b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.341953 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.341926 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfkp7\" (UniqueName: \"kubernetes.io/projected/6f8697db-185a-496e-a21a-2d56e33297b9-kube-api-access-lfkp7\") pod \"node-exporter-brbdv\" (UID: \"6f8697db-185a-496e-a21a-2d56e33297b9\") " pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.434129 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.434102 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-brbdv" Oct 30 22:08:53.436280 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.436255 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:53.444607 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:08:53.444577 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8697db_185a_496e_a21a_2d56e33297b9.slice/crio-80ce22e3f8ffe960c5a58f7610fd65bbb42fe6b02d7d2b214f748a2e19263baa WatchSource:0}: Error finding container 80ce22e3f8ffe960c5a58f7610fd65bbb42fe6b02d7d2b214f748a2e19263baa: Status 404 returned error can't find the container with id 80ce22e3f8ffe960c5a58f7610fd65bbb42fe6b02d7d2b214f748a2e19263baa Oct 30 22:08:53.692838 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.692762 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brbdv" event={"ID":"6f8697db-185a-496e-a21a-2d56e33297b9","Type":"ContainerStarted","Data":"80ce22e3f8ffe960c5a58f7610fd65bbb42fe6b02d7d2b214f748a2e19263baa"} Oct 30 22:08:53.701594 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.701566 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:53.962003 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:53.961930 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:54.451385 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:54.451344 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:54.719182 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:54.719111 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:55.357981 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:55.357920 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:55.700057 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:55.700026 4497 generic.go:356] "Generic (PLEG): container finished" podID="6f8697db-185a-496e-a21a-2d56e33297b9" containerID="9dbaa695f370ccc8d0f765e6da12818b8c5d5599fe1be75c8f32f30896b1f7bb" exitCode=0 Oct 30 22:08:55.700193 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:55.700075 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brbdv" event={"ID":"6f8697db-185a-496e-a21a-2d56e33297b9","Type":"ContainerDied","Data":"9dbaa695f370ccc8d0f765e6da12818b8c5d5599fe1be75c8f32f30896b1f7bb"} Oct 30 22:08:56.566520 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:56.566491 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:56.705156 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:56.705123 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brbdv" event={"ID":"6f8697db-185a-496e-a21a-2d56e33297b9","Type":"ContainerStarted","Data":"a07f818cb192103a230aeab1d93f2f8797a0e730707fc0b9d7a4897b3efd120d"} Oct 30 22:08:56.705340 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:56.705215 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brbdv" event={"ID":"6f8697db-185a-496e-a21a-2d56e33297b9","Type":"ContainerStarted","Data":"74b5d44153cc295e6f32f3f6df784e7a4b83df837d6dae6e52f572a32ffc43ad"} Oct 30 22:08:56.825384 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:56.825312 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-brbdv" podStartSLOduration=2.176888749 podStartE2EDuration="3.825300106s" totalImagesPullingTime="1.57047298s" totalInitContainerRuntime="77.938377ms" isStatefulPod=true podCreationTimestamp="2026-10-30 22:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:56.824630881 +0000 UTC m=+31.451696430" watchObservedRunningTime="2026-10-30 22:08:56.825300106 +0000 UTC m=+31.452365656" Oct 30 22:08:56.857356 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:56.857325 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:57.676083 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:57.676048 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:58.080744 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:58.080670 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:58.642866 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:58.642821 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:58.891167 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:58.891137 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:59.652694 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:08:59.652664 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:08:59.823821 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:08:59.823788 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:00.088773 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:00.088694 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:00.961926 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:00.961903 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-chglk" Oct 30 22:09:02.035959 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:02.035924 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:02.284179 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:02.284148 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:02.706328 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:02.706297 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:04.791085 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:04.791050 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:05.040897 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:05.040866 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:05.304676 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:05.304639 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:05.394608 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:05.394583 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-48xkh"] Oct 30 22:09:05.396402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:05.396385 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-48xkh" Oct 30 22:09:05.452619 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:05.452599 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 30 22:09:05.452730 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:05.452717 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 30 22:09:05.460139 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:05.460113 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzrzg\" (UniqueName: \"kubernetes.io/projected/d205edc5-f396-4209-ab4e-9c337c54ae57-kube-api-access-mzrzg\") pod \"downloads-6dd789c8b7-48xkh\" (UID: \"d205edc5-f396-4209-ab4e-9c337c54ae57\") " pod="openshift-console/downloads-6dd789c8b7-48xkh" Oct 30 22:09:05.460207 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:05.460145 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d205edc5-f396-4209-ab4e-9c337c54ae57-tmp\") pod \"downloads-6dd789c8b7-48xkh\" (UID: \"d205edc5-f396-4209-ab4e-9c337c54ae57\") " pod="openshift-console/downloads-6dd789c8b7-48xkh" Oct 30 22:09:05.501917 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:05.501897 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-48xkh"] Oct 30 22:09:05.560698 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:05.560650 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzrzg\" (UniqueName: \"kubernetes.io/projected/d205edc5-f396-4209-ab4e-9c337c54ae57-kube-api-access-mzrzg\") pod \"downloads-6dd789c8b7-48xkh\" (UID: \"d205edc5-f396-4209-ab4e-9c337c54ae57\") " pod="openshift-console/downloads-6dd789c8b7-48xkh" Oct 30 22:09:05.560698 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:05.560679 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d205edc5-f396-4209-ab4e-9c337c54ae57-tmp\") pod \"downloads-6dd789c8b7-48xkh\" (UID: \"d205edc5-f396-4209-ab4e-9c337c54ae57\") " pod="openshift-console/downloads-6dd789c8b7-48xkh" Oct 30 22:09:05.561023 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:05.560996 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d205edc5-f396-4209-ab4e-9c337c54ae57-tmp\") pod \"downloads-6dd789c8b7-48xkh\" (UID: \"d205edc5-f396-4209-ab4e-9c337c54ae57\") " pod="openshift-console/downloads-6dd789c8b7-48xkh" Oct 30 22:09:05.623447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:05.623421 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzrzg\" (UniqueName: \"kubernetes.io/projected/d205edc5-f396-4209-ab4e-9c337c54ae57-kube-api-access-mzrzg\") pod \"downloads-6dd789c8b7-48xkh\" (UID: \"d205edc5-f396-4209-ab4e-9c337c54ae57\") " pod="openshift-console/downloads-6dd789c8b7-48xkh" Oct 30 22:09:05.706067 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:05.706047 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-48xkh" Oct 30 22:09:06.062845 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:06.062769 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:06.179687 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:06.179654 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-48xkh"] Oct 30 22:09:06.217735 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:09:06.217692 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd205edc5_f396_4209_ab4e_9c337c54ae57.slice/crio-a1a2a1251a1536f385b4f53a87a7688b4e50f4914ffed775d619571b6193b131 WatchSource:0}: Error finding container a1a2a1251a1536f385b4f53a87a7688b4e50f4914ffed775d619571b6193b131: Status 404 returned error can't find the container with id a1a2a1251a1536f385b4f53a87a7688b4e50f4914ffed775d619571b6193b131 Oct 30 22:09:06.331721 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:06.331653 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:06.675282 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:06.675255 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d58b598bd-pscfp" Oct 30 22:09:06.737988 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:06.737951 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-48xkh" event={"ID":"d205edc5-f396-4209-ab4e-9c337c54ae57","Type":"ContainerStarted","Data":"a1a2a1251a1536f385b4f53a87a7688b4e50f4914ffed775d619571b6193b131"} Oct 30 22:09:06.809856 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:06.809831 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:07.092624 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:07.092546 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:07.354387 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:07.354304 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:07.703823 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:07.703790 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:12.377340 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:12.377298 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:12.721690 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:12.721612 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:14.849891 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:14.849850 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:15.050534 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.050499 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-56dd6c9df9-vcjxp"] Oct 30 22:09:15.053125 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.053104 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.128116 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.128051 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:15.128346 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.128321 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-serving-cert\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.128496 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.128470 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnztc\" (UniqueName: \"kubernetes.io/projected/4dd90afb-573d-4c29-a15b-2f12a70a6d10-kube-api-access-wnztc\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.128577 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.128523 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dd90afb-573d-4c29-a15b-2f12a70a6d10-tmp\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.128577 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.128548 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-config\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.128662 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.128638 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-oauth-serving-cert\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.128708 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.128670 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-service-ca\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.128740 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.128705 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-oauth-config\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.161340 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.161304 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 30 22:09:15.161451 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.161363 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 30 22:09:15.161507 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.161444 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 30 22:09:15.161557 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.161504 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-r2tfm\"" Oct 30 22:09:15.161557 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.161450 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 30 22:09:15.161918 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.161900 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 30 22:09:15.206500 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.206473 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56dd6c9df9-vcjxp"] Oct 30 22:09:15.229571 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.229549 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-oauth-config\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.229694 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.229579 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-serving-cert\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.229694 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.229631 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnztc\" (UniqueName: \"kubernetes.io/projected/4dd90afb-573d-4c29-a15b-2f12a70a6d10-kube-api-access-wnztc\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.229849 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.229784 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dd90afb-573d-4c29-a15b-2f12a70a6d10-tmp\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.229849 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.229827 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-config\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.230007 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.229857 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-oauth-serving-cert\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.230007 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.229883 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-service-ca\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.230174 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.230153 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dd90afb-573d-4c29-a15b-2f12a70a6d10-tmp\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.230595 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.230574 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-service-ca\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.230749 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.230726 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-oauth-serving-cert\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.230799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.230748 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-config\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.232440 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.232424 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-serving-cert\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.232558 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.232540 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-oauth-config\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.304609 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.304584 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnztc\" (UniqueName: \"kubernetes.io/projected/4dd90afb-573d-4c29-a15b-2f12a70a6d10-kube-api-access-wnztc\") pod \"console-56dd6c9df9-vcjxp\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.364422 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.364399 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:15.452289 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.452262 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:15.719258 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.719157 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:15.742843 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.742818 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56dd6c9df9-vcjxp"] Oct 30 22:09:15.746254 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:09:15.746218 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd90afb_573d_4c29_a15b_2f12a70a6d10.slice/crio-0f8d1a4705129921d4bee480f44b7c1e0d7bd77c0100a7de2d66ac231ade78b5 WatchSource:0}: Error finding container 0f8d1a4705129921d4bee480f44b7c1e0d7bd77c0100a7de2d66ac231ade78b5: Status 404 returned error can't find the container with id 0f8d1a4705129921d4bee480f44b7c1e0d7bd77c0100a7de2d66ac231ade78b5 Oct 30 22:09:15.771210 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:15.771176 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dd6c9df9-vcjxp" event={"ID":"4dd90afb-573d-4c29-a15b-2f12a70a6d10","Type":"ContainerStarted","Data":"0f8d1a4705129921d4bee480f44b7c1e0d7bd77c0100a7de2d66ac231ade78b5"} Oct 30 22:09:17.677804 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:17.677771 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:17.922532 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:17.922496 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:19.787571 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:19.787539 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dd6c9df9-vcjxp" event={"ID":"4dd90afb-573d-4c29-a15b-2f12a70a6d10","Type":"ContainerStarted","Data":"2b9e1f07dc1a3fa4699473ae8f290c7ea82fbdd94b4af401d2e231c7ab838bb1"} Oct 30 22:09:19.919202 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:19.919149 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-56dd6c9df9-vcjxp" podStartSLOduration=2.406632382 podStartE2EDuration="5.91913647s" totalImagesPullingTime="3.512504088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:09:19.918675858 +0000 UTC m=+54.545741410" watchObservedRunningTime="2026-10-30 22:09:19.91913647 +0000 UTC m=+54.546202020" Oct 30 22:09:23.149806 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:23.149765 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:23.406187 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:23.406101 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:23.809806 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:23.809719 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-48xkh" event={"ID":"d205edc5-f396-4209-ab4e-9c337c54ae57","Type":"ContainerStarted","Data":"69b7c1cdb8b9e0bfd959795073074252733831501ad1dc58352146ae7011a2d1"} Oct 30 22:09:23.809985 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:23.809962 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-48xkh" Oct 30 22:09:23.828621 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:23.828596 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-48xkh" Oct 30 22:09:24.028380 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:24.028323 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-48xkh" podStartSLOduration=2.437919201 podStartE2EDuration="19.028308018s" totalImagesPullingTime="16.590388817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:09:23.977823372 +0000 UTC m=+58.604888924" watchObservedRunningTime="2026-10-30 22:09:24.028308018 +0000 UTC m=+58.655373565" Oct 30 22:09:25.365051 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:25.365015 4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:25.365513 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:25.365080 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:25.370735 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:25.370709 4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:25.822221 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:25.822190 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:09:27.732954 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.732916 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-566f4fb975-ql82z"] Oct 30 22:09:27.762178 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.762151 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.833535 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.833504 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-config\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.833703 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.833545 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-serving-cert\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.833703 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.833568 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-service-ca\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.833703 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.833634 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-oauth-config\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.833703 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.833696 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-trusted-ca-bundle\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.833921 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.833725 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffnm6\" (UniqueName: \"kubernetes.io/projected/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-kube-api-access-ffnm6\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.833921 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.833743 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-oauth-serving-cert\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.833921 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.833762 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-tmp\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.935031 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.934989 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-config\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.935031 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.935033 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-serving-cert\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.935286 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.935050 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-service-ca\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.935286 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.935176 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-oauth-config\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.935286 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.935226 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-trusted-ca-bundle\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.935456 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.935292 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffnm6\" (UniqueName: \"kubernetes.io/projected/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-kube-api-access-ffnm6\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.935456 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.935323 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-oauth-serving-cert\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.935456 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.935358 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-tmp\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.935744 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.935718 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-tmp\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.936284 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.936259 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-service-ca\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.936834 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.936812 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-config\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.936990 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.936964 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-oauth-serving-cert\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.938073 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.938049 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-serving-cert\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.938162 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.938091 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-oauth-config\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:27.966189 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.966158 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Oct 30 22:09:27.967610 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.967586 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566f4fb975-ql82z"] Oct 30 22:09:27.976108 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:27.976091 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-trusted-ca-bundle\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:28.000613 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:28.000564 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffnm6\" (UniqueName: \"kubernetes.io/projected/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-kube-api-access-ffnm6\") pod \"console-566f4fb975-ql82z\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:28.088748 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:28.088719 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:28.338163 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:28.338077 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:28.490929 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:28.490899 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566f4fb975-ql82z"] Oct 30 22:09:28.519380 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:09:28.519353 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa6ad72d_768e_41f5_a57b_5bd7c55979b2.slice/crio-58c16f14df61659e7ed48738bf429c02985feced29427d4b526d5d62eb1a1eaf WatchSource:0}: Error finding container 58c16f14df61659e7ed48738bf429c02985feced29427d4b526d5d62eb1a1eaf: Status 404 returned error can't find the container with id 58c16f14df61659e7ed48738bf429c02985feced29427d4b526d5d62eb1a1eaf Oct 30 22:09:28.745658 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:28.745621 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:28.830500 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:28.830457 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566f4fb975-ql82z" event={"ID":"fa6ad72d-768e-41f5-a57b-5bd7c55979b2","Type":"ContainerStarted","Data":"b53a8a1dbd6b29a788648b031d509b026388feac0e60ce1db4204da3ebbdd41b"} Oct 30 22:09:28.830676 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:28.830522 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566f4fb975-ql82z" event={"ID":"fa6ad72d-768e-41f5-a57b-5bd7c55979b2","Type":"ContainerStarted","Data":"58c16f14df61659e7ed48738bf429c02985feced29427d4b526d5d62eb1a1eaf"} Oct 30 22:09:28.952418 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:28.952366 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-566f4fb975-ql82z" podStartSLOduration=1.952353409 podStartE2EDuration="1.952353409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:09:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:09:28.952169555 +0000 UTC m=+63.579235109" watchObservedRunningTime="2026-10-30 22:09:28.952353409 +0000 UTC m=+63.579418960" Oct 30 22:09:29.662120 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:09:29.662077 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:09:30.578018 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:30.577988 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:30.869861 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:30.869779 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:31.164853 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:31.164823 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:38.089349 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.089313 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:38.090093 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.089378 4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:38.094217 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.094195 4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:38.515820 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.515787 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-zgdkz-zxwv9"] Oct 30 22:09:38.516052 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.515961 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" podUID="d9695030-e34c-40b4-90d1-93cc907cd491" containerName="insights-gathering" containerID="cri-o://1c2af0f6cc749191d7a80d0c87de69cc1738ab97682b18ca0ac21f31dc75b0d9" gracePeriod=30 Oct 30 22:09:38.761391 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.761349 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:38.822357 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.822332 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:09:38.863938 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.863902 4497 generic.go:356] "Generic (PLEG): container finished" podID="d9695030-e34c-40b4-90d1-93cc907cd491" containerID="1c2af0f6cc749191d7a80d0c87de69cc1738ab97682b18ca0ac21f31dc75b0d9" exitCode=2 Oct 30 22:09:38.864080 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.863959 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" Oct 30 22:09:38.864080 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.863990 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" event={"ID":"d9695030-e34c-40b4-90d1-93cc907cd491","Type":"ContainerDied","Data":"1c2af0f6cc749191d7a80d0c87de69cc1738ab97682b18ca0ac21f31dc75b0d9"} Oct 30 22:09:38.864080 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.864058 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-zgdkz-zxwv9" event={"ID":"d9695030-e34c-40b4-90d1-93cc907cd491","Type":"ContainerDied","Data":"85d23c975f0655f6a4491b5d86268bbe67017647d014dd4a0c2ef16ce4436b61"} Oct 30 22:09:38.864193 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.864086 4497 scope.go:122] "RemoveContainer" containerID="1c2af0f6cc749191d7a80d0c87de69cc1738ab97682b18ca0ac21f31dc75b0d9" Oct 30 22:09:38.868194 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.868174 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:09:38.872112 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.872093 4497 scope.go:122] "RemoveContainer" containerID="1c2af0f6cc749191d7a80d0c87de69cc1738ab97682b18ca0ac21f31dc75b0d9" Oct 30 22:09:38.872405 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:09:38.872384 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c2af0f6cc749191d7a80d0c87de69cc1738ab97682b18ca0ac21f31dc75b0d9\": container with ID starting with 1c2af0f6cc749191d7a80d0c87de69cc1738ab97682b18ca0ac21f31dc75b0d9 not found: ID does not exist" containerID="1c2af0f6cc749191d7a80d0c87de69cc1738ab97682b18ca0ac21f31dc75b0d9" Oct 30 22:09:38.872477 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.872414 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c2af0f6cc749191d7a80d0c87de69cc1738ab97682b18ca0ac21f31dc75b0d9"} err="failed to get container status \"1c2af0f6cc749191d7a80d0c87de69cc1738ab97682b18ca0ac21f31dc75b0d9\": rpc error: code = NotFound desc = could not find container \"1c2af0f6cc749191d7a80d0c87de69cc1738ab97682b18ca0ac21f31dc75b0d9\": container with ID starting with 1c2af0f6cc749191d7a80d0c87de69cc1738ab97682b18ca0ac21f31dc75b0d9 not found: ID does not exist" Oct 30 22:09:38.906665 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.906640 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9695030-e34c-40b4-90d1-93cc907cd491-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/d9695030-e34c-40b4-90d1-93cc907cd491-archives-path\") pod \"d9695030-e34c-40b4-90d1-93cc907cd491\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " Oct 30 22:09:38.906767 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.906686 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d9695030-e34c-40b4-90d1-93cc907cd491-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9695030-e34c-40b4-90d1-93cc907cd491-trusted-ca-bundle\") pod \"d9695030-e34c-40b4-90d1-93cc907cd491\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " Oct 30 22:09:38.906767 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.906744 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d9695030-e34c-40b4-90d1-93cc907cd491-kube-api-access-7kkxd\" (UniqueName: \"kubernetes.io/projected/d9695030-e34c-40b4-90d1-93cc907cd491-kube-api-access-7kkxd\") pod \"d9695030-e34c-40b4-90d1-93cc907cd491\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " Oct 30 22:09:38.906870 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.906797 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d9695030-e34c-40b4-90d1-93cc907cd491-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9695030-e34c-40b4-90d1-93cc907cd491-service-ca-bundle\") pod \"d9695030-e34c-40b4-90d1-93cc907cd491\" (UID: \"d9695030-e34c-40b4-90d1-93cc907cd491\") " Oct 30 22:09:38.906983 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.906960 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9695030-e34c-40b4-90d1-93cc907cd491-archives-path" pod "d9695030-e34c-40b4-90d1-93cc907cd491" (UID: "d9695030-e34c-40b4-90d1-93cc907cd491"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:09:38.907155 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.907134 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9695030-e34c-40b4-90d1-93cc907cd491-trusted-ca-bundle" pod "d9695030-e34c-40b4-90d1-93cc907cd491" (UID: "d9695030-e34c-40b4-90d1-93cc907cd491"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:09:38.907231 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.907208 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9695030-e34c-40b4-90d1-93cc907cd491-service-ca-bundle" pod "d9695030-e34c-40b4-90d1-93cc907cd491" (UID: "d9695030-e34c-40b4-90d1-93cc907cd491"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:09:38.908969 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:38.908945 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9695030-e34c-40b4-90d1-93cc907cd491-kube-api-access-7kkxd" pod "d9695030-e34c-40b4-90d1-93cc907cd491" (UID: "d9695030-e34c-40b4-90d1-93cc907cd491"). InnerVolumeSpecName "kube-api-access-7kkxd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:09:39.008124 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:39.008098 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kkxd\" (UniqueName: \"kubernetes.io/projected/d9695030-e34c-40b4-90d1-93cc907cd491-kube-api-access-7kkxd\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:09:39.008266 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:39.008131 4497 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9695030-e34c-40b4-90d1-93cc907cd491-service-ca-bundle\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:09:39.008266 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:39.008149 4497 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/d9695030-e34c-40b4-90d1-93cc907cd491-archives-path\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:09:39.008266 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:39.008164 4497 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9695030-e34c-40b4-90d1-93cc907cd491-trusted-ca-bundle\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:09:39.037778 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:39.037723 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:39.091845 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:39.091823 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56dd6c9df9-vcjxp"] Oct 30 22:09:39.349042 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:39.348953 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-zgdkz-zxwv9"] Oct 30 22:09:39.352061 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:39.352040 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-zgdkz-zxwv9"] Oct 30 22:09:39.538866 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:39.538841 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d9695030-e34c-40b4-90d1-93cc907cd491" path="/var/lib/kubelet/pods/d9695030-e34c-40b4-90d1-93cc907cd491/volumes" Oct 30 22:09:44.725294 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:44.725257 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:45.157455 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:45.157429 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:59.653138 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:09:59.653104 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:09:59.887582 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:09:59.887547 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:00.160027 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:00.159997 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:04.111148 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.111109 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-56dd6c9df9-vcjxp" podUID="4dd90afb-573d-4c29-a15b-2f12a70a6d10" containerName="console" containerID="cri-o://2b9e1f07dc1a3fa4699473ae8f290c7ea82fbdd94b4af401d2e231c7ab838bb1" gracePeriod=15 Oct 30 22:10:04.393493 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.393471 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:10:04.574038 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.574009 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4dd90afb-573d-4c29-a15b-2f12a70a6d10-kube-api-access-wnztc\" (UniqueName: \"kubernetes.io/projected/4dd90afb-573d-4c29-a15b-2f12a70a6d10-kube-api-access-wnztc\") pod \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " Oct 30 22:10:04.574170 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.574049 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-serving-cert\") pod \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " Oct 30 22:10:04.574170 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.574080 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4dd90afb-573d-4c29-a15b-2f12a70a6d10-tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dd90afb-573d-4c29-a15b-2f12a70a6d10-tmp\") pod \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " Oct 30 22:10:04.574170 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.574122 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-service-ca\") pod \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " Oct 30 22:10:04.574170 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.574143 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-oauth-serving-cert\") pod \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " Oct 30 22:10:04.574170 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.574162 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-config\" (UniqueName: \"kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-config\") pod \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " Oct 30 22:10:04.574458 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.574207 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-oauth-config\") pod \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\" (UID: \"4dd90afb-573d-4c29-a15b-2f12a70a6d10\") " Oct 30 22:10:04.574570 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.574539 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dd90afb-573d-4c29-a15b-2f12a70a6d10-tmp" pod "4dd90afb-573d-4c29-a15b-2f12a70a6d10" (UID: "4dd90afb-573d-4c29-a15b-2f12a70a6d10"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:10:04.574639 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.574617 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-service-ca" pod "4dd90afb-573d-4c29-a15b-2f12a70a6d10" (UID: "4dd90afb-573d-4c29-a15b-2f12a70a6d10"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:10:04.574639 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.574624 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-oauth-serving-cert" pod "4dd90afb-573d-4c29-a15b-2f12a70a6d10" (UID: "4dd90afb-573d-4c29-a15b-2f12a70a6d10"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:10:04.574719 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.574645 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-config" pod "4dd90afb-573d-4c29-a15b-2f12a70a6d10" (UID: "4dd90afb-573d-4c29-a15b-2f12a70a6d10"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:10:04.576566 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.576546 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-oauth-config" pod "4dd90afb-573d-4c29-a15b-2f12a70a6d10" (UID: "4dd90afb-573d-4c29-a15b-2f12a70a6d10"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:10:04.576804 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.576780 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dd90afb-573d-4c29-a15b-2f12a70a6d10-kube-api-access-wnztc" pod "4dd90afb-573d-4c29-a15b-2f12a70a6d10" (UID: "4dd90afb-573d-4c29-a15b-2f12a70a6d10"). InnerVolumeSpecName "kube-api-access-wnztc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:10:04.576804 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.576782 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-serving-cert" pod "4dd90afb-573d-4c29-a15b-2f12a70a6d10" (UID: "4dd90afb-573d-4c29-a15b-2f12a70a6d10"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:10:04.675034 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.675013 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnztc\" (UniqueName: \"kubernetes.io/projected/4dd90afb-573d-4c29-a15b-2f12a70a6d10-kube-api-access-wnztc\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:10:04.675034 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.675033 4497 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-serving-cert\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:10:04.675161 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.675043 4497 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dd90afb-573d-4c29-a15b-2f12a70a6d10-tmp\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:10:04.675161 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.675052 4497 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-service-ca\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:10:04.675161 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.675060 4497 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-oauth-serving-cert\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:10:04.675161 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.675071 4497 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-config\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:10:04.675161 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.675086 4497 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dd90afb-573d-4c29-a15b-2f12a70a6d10-console-oauth-config\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:10:04.949395 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.949328 4497 generic.go:356] "Generic (PLEG): container finished" podID="4dd90afb-573d-4c29-a15b-2f12a70a6d10" containerID="2b9e1f07dc1a3fa4699473ae8f290c7ea82fbdd94b4af401d2e231c7ab838bb1" exitCode=0 Oct 30 22:10:04.949395 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.949377 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dd6c9df9-vcjxp" Oct 30 22:10:04.949547 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.949409 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dd6c9df9-vcjxp" event={"ID":"4dd90afb-573d-4c29-a15b-2f12a70a6d10","Type":"ContainerDied","Data":"2b9e1f07dc1a3fa4699473ae8f290c7ea82fbdd94b4af401d2e231c7ab838bb1"} Oct 30 22:10:04.949547 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.949457 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dd6c9df9-vcjxp" event={"ID":"4dd90afb-573d-4c29-a15b-2f12a70a6d10","Type":"ContainerDied","Data":"0f8d1a4705129921d4bee480f44b7c1e0d7bd77c0100a7de2d66ac231ade78b5"} Oct 30 22:10:04.949547 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.949476 4497 scope.go:122] "RemoveContainer" containerID="2b9e1f07dc1a3fa4699473ae8f290c7ea82fbdd94b4af401d2e231c7ab838bb1" Oct 30 22:10:04.987740 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.987719 4497 scope.go:122] "RemoveContainer" containerID="2b9e1f07dc1a3fa4699473ae8f290c7ea82fbdd94b4af401d2e231c7ab838bb1" Oct 30 22:10:04.988036 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:10:04.988016 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b9e1f07dc1a3fa4699473ae8f290c7ea82fbdd94b4af401d2e231c7ab838bb1\": container with ID starting with 2b9e1f07dc1a3fa4699473ae8f290c7ea82fbdd94b4af401d2e231c7ab838bb1 not found: ID does not exist" containerID="2b9e1f07dc1a3fa4699473ae8f290c7ea82fbdd94b4af401d2e231c7ab838bb1" Oct 30 22:10:04.988101 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:04.988047 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b9e1f07dc1a3fa4699473ae8f290c7ea82fbdd94b4af401d2e231c7ab838bb1"} err="failed to get container status \"2b9e1f07dc1a3fa4699473ae8f290c7ea82fbdd94b4af401d2e231c7ab838bb1\": rpc error: code = NotFound desc = could not find container \"2b9e1f07dc1a3fa4699473ae8f290c7ea82fbdd94b4af401d2e231c7ab838bb1\": container with ID starting with 2b9e1f07dc1a3fa4699473ae8f290c7ea82fbdd94b4af401d2e231c7ab838bb1 not found: ID does not exist" Oct 30 22:10:05.119778 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:05.116428 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56dd6c9df9-vcjxp"] Oct 30 22:10:05.165591 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:05.165562 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56dd6c9df9-vcjxp"] Oct 30 22:10:05.538654 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:05.538622 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4dd90afb-573d-4c29-a15b-2f12a70a6d10" path="/var/lib/kubelet/pods/4dd90afb-573d-4c29-a15b-2f12a70a6d10/volumes" Oct 30 22:10:12.312257 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:12.312198 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:12.642609 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:12.642572 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:12.917894 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:12.917817 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:15.820077 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:15.820046 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5995f846-n4sng"] Oct 30 22:10:15.820509 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:15.820291 4497 cpu_manager.go:414] "containerMap: removing container" podUID="4dd90afb-573d-4c29-a15b-2f12a70a6d10" containerName="console" Oct 30 22:10:15.820509 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:15.820303 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4dd90afb-573d-4c29-a15b-2f12a70a6d10" containerName="console" Oct 30 22:10:15.820509 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:15.820317 4497 cpu_manager.go:414] "containerMap: removing container" podUID="d9695030-e34c-40b4-90d1-93cc907cd491" containerName="insights-gathering" Oct 30 22:10:15.820509 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:15.820322 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d9695030-e34c-40b4-90d1-93cc907cd491" containerName="insights-gathering" Oct 30 22:10:15.820509 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:15.820366 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="4dd90afb-573d-4c29-a15b-2f12a70a6d10" containerName="console" Oct 30 22:10:15.820509 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:15.820375 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="d9695030-e34c-40b4-90d1-93cc907cd491" containerName="insights-gathering" Oct 30 22:10:15.821921 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:15.821907 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:15.924817 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:15.924792 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5995f846-n4sng"] Oct 30 22:10:15.943110 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:15.943079 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-tmp\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:15.943229 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:15.943118 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-oauth-serving-cert\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:15.943229 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:15.943163 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-console-config\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:15.943229 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:15.943192 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-trusted-ca-bundle\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:15.943374 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:15.943276 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-service-ca\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:15.943374 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:15.943344 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-console-oauth-config\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:15.943374 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:15.943361 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-console-serving-cert\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:15.943522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:15.943378 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwtpd\" (UniqueName: \"kubernetes.io/projected/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-kube-api-access-xwtpd\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:16.043848 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.043815 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-console-serving-cert\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:16.043848 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.043844 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwtpd\" (UniqueName: \"kubernetes.io/projected/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-kube-api-access-xwtpd\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:16.044146 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.043887 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-tmp\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:16.044146 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.043911 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-oauth-serving-cert\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:16.044146 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.043936 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-console-config\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:16.044146 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.043968 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-trusted-ca-bundle\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:16.044146 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.043991 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-service-ca\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:16.044146 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.044023 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-console-oauth-config\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:16.044477 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.044357 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-tmp\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:16.044854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.044831 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-oauth-serving-cert\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:16.045014 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.044984 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-console-config\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:16.045067 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.045037 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-service-ca\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:16.045275 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.045231 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-trusted-ca-bundle\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:16.046494 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.046470 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-console-oauth-config\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:16.046668 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.046649 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-console-serving-cert\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:16.107833 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.107773 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwtpd\" (UniqueName: \"kubernetes.io/projected/06e4ca34-03e1-47dc-9f46-04ffb9b110d0-kube-api-access-xwtpd\") pod \"console-5995f846-n4sng\" (UID: \"06e4ca34-03e1-47dc-9f46-04ffb9b110d0\") " pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:16.132024 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.132001 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:16.186648 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.186615 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:16.485702 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.485662 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:16.503495 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.503472 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5995f846-n4sng"] Oct 30 22:10:16.506012 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:10:16.505985 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e4ca34_03e1_47dc_9f46_04ffb9b110d0.slice/crio-ce7012e80abfe3ee95fc684597a0ee93c351ad012cea08e630322d67f7972ef7 WatchSource:0}: Error finding container ce7012e80abfe3ee95fc684597a0ee93c351ad012cea08e630322d67f7972ef7: Status 404 returned error can't find the container with id ce7012e80abfe3ee95fc684597a0ee93c351ad012cea08e630322d67f7972ef7 Oct 30 22:10:16.731652 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.731609 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:16.988256 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.988196 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5995f846-n4sng" event={"ID":"06e4ca34-03e1-47dc-9f46-04ffb9b110d0","Type":"ContainerStarted","Data":"111ff2242e29ec20170567c316df5b64f0e0c9e746d5f39fb583278c19f75f22"} Oct 30 22:10:16.988727 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:16.988263 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5995f846-n4sng" event={"ID":"06e4ca34-03e1-47dc-9f46-04ffb9b110d0","Type":"ContainerStarted","Data":"ce7012e80abfe3ee95fc684597a0ee93c351ad012cea08e630322d67f7972ef7"} Oct 30 22:10:17.114928 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:17.114884 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5995f846-n4sng" podStartSLOduration=2.114869459 podStartE2EDuration="2.114869459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:10:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:10:17.114195314 +0000 UTC m=+111.741260864" watchObservedRunningTime="2026-10-30 22:10:17.114869459 +0000 UTC m=+111.741935001" Oct 30 22:10:20.139348 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:20.139308 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:24.940010 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:24.939968 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:25.192141 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:25.192053 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:26.132811 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:26.132782 4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:26.133163 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:26.132842 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:26.137129 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:26.137107 4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:27.029762 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:27.029727 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5995f846-n4sng" Oct 30 22:10:27.215885 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:27.215854 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566f4fb975-ql82z"] Oct 30 22:10:29.654944 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:10:29.654910 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:10:29.826262 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:29.826207 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:30.129033 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:30.129001 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:52.235773 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.235684 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-566f4fb975-ql82z" podUID="fa6ad72d-768e-41f5-a57b-5bd7c55979b2" containerName="console" containerID="cri-o://b53a8a1dbd6b29a788648b031d509b026388feac0e60ce1db4204da3ebbdd41b" gracePeriod=15 Oct 30 22:10:52.474687 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.474665 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:10:52.590881 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.590826 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-tmp\") pod \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " Oct 30 22:10:52.590881 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.590860 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-serving-cert\") pod \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " Oct 30 22:10:52.591036 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.590884 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-config\" (UniqueName: \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-config\") pod \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " Oct 30 22:10:52.591036 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.590919 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-trusted-ca-bundle\") pod \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " Oct 30 22:10:52.591036 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.590938 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-oauth-config\") pod \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " Oct 30 22:10:52.591036 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.590961 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-service-ca\") pod \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " Oct 30 22:10:52.591036 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.590992 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-oauth-serving-cert\") pod \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " Oct 30 22:10:52.591321 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.591090 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-tmp" pod "fa6ad72d-768e-41f5-a57b-5bd7c55979b2" (UID: "fa6ad72d-768e-41f5-a57b-5bd7c55979b2"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:10:52.591321 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.591169 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-kube-api-access-ffnm6\" (UniqueName: \"kubernetes.io/projected/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-kube-api-access-ffnm6\") pod \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\" (UID: \"fa6ad72d-768e-41f5-a57b-5bd7c55979b2\") " Oct 30 22:10:52.591423 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.591378 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-oauth-serving-cert" pod "fa6ad72d-768e-41f5-a57b-5bd7c55979b2" (UID: "fa6ad72d-768e-41f5-a57b-5bd7c55979b2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:10:52.591423 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.591400 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-trusted-ca-bundle" pod "fa6ad72d-768e-41f5-a57b-5bd7c55979b2" (UID: "fa6ad72d-768e-41f5-a57b-5bd7c55979b2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:10:52.591525 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.591410 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-service-ca" pod "fa6ad72d-768e-41f5-a57b-5bd7c55979b2" (UID: "fa6ad72d-768e-41f5-a57b-5bd7c55979b2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:10:52.591582 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.591562 4497 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-trusted-ca-bundle\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:10:52.591638 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.591582 4497 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-service-ca\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:10:52.591638 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.591596 4497 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-oauth-serving-cert\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:10:52.591638 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.591610 4497 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-tmp\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:10:52.591960 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.591935 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-config" pod "fa6ad72d-768e-41f5-a57b-5bd7c55979b2" (UID: "fa6ad72d-768e-41f5-a57b-5bd7c55979b2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:10:52.593309 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.593284 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-serving-cert" pod "fa6ad72d-768e-41f5-a57b-5bd7c55979b2" (UID: "fa6ad72d-768e-41f5-a57b-5bd7c55979b2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:10:52.593425 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.593391 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-kube-api-access-ffnm6" pod "fa6ad72d-768e-41f5-a57b-5bd7c55979b2" (UID: "fa6ad72d-768e-41f5-a57b-5bd7c55979b2"). InnerVolumeSpecName "kube-api-access-ffnm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:10:52.593769 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.593745 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-oauth-config" pod "fa6ad72d-768e-41f5-a57b-5bd7c55979b2" (UID: "fa6ad72d-768e-41f5-a57b-5bd7c55979b2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:10:52.692314 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.692292 4497 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-serving-cert\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:10:52.692314 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.692313 4497 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-config\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:10:52.692443 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.692324 4497 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-console-oauth-config\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:10:52.692443 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:52.692333 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffnm6\" (UniqueName: \"kubernetes.io/projected/fa6ad72d-768e-41f5-a57b-5bd7c55979b2-kube-api-access-ffnm6\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:10:53.108839 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:53.108810 4497 generic.go:356] "Generic (PLEG): container finished" podID="fa6ad72d-768e-41f5-a57b-5bd7c55979b2" containerID="b53a8a1dbd6b29a788648b031d509b026388feac0e60ce1db4204da3ebbdd41b" exitCode=0 Oct 30 22:10:53.108998 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:53.108862 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566f4fb975-ql82z" Oct 30 22:10:53.108998 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:53.108890 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566f4fb975-ql82z" event={"ID":"fa6ad72d-768e-41f5-a57b-5bd7c55979b2","Type":"ContainerDied","Data":"b53a8a1dbd6b29a788648b031d509b026388feac0e60ce1db4204da3ebbdd41b"} Oct 30 22:10:53.108998 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:53.108934 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566f4fb975-ql82z" event={"ID":"fa6ad72d-768e-41f5-a57b-5bd7c55979b2","Type":"ContainerDied","Data":"58c16f14df61659e7ed48738bf429c02985feced29427d4b526d5d62eb1a1eaf"} Oct 30 22:10:53.108998 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:53.108954 4497 scope.go:122] "RemoveContainer" containerID="b53a8a1dbd6b29a788648b031d509b026388feac0e60ce1db4204da3ebbdd41b" Oct 30 22:10:53.116776 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:53.116762 4497 scope.go:122] "RemoveContainer" containerID="b53a8a1dbd6b29a788648b031d509b026388feac0e60ce1db4204da3ebbdd41b" Oct 30 22:10:53.117028 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:10:53.117009 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b53a8a1dbd6b29a788648b031d509b026388feac0e60ce1db4204da3ebbdd41b\": container with ID starting with b53a8a1dbd6b29a788648b031d509b026388feac0e60ce1db4204da3ebbdd41b not found: ID does not exist" containerID="b53a8a1dbd6b29a788648b031d509b026388feac0e60ce1db4204da3ebbdd41b" Oct 30 22:10:53.117093 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:53.117040 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b53a8a1dbd6b29a788648b031d509b026388feac0e60ce1db4204da3ebbdd41b"} err="failed to get container status \"b53a8a1dbd6b29a788648b031d509b026388feac0e60ce1db4204da3ebbdd41b\": rpc error: code = NotFound desc = could not find container \"b53a8a1dbd6b29a788648b031d509b026388feac0e60ce1db4204da3ebbdd41b\": container with ID starting with b53a8a1dbd6b29a788648b031d509b026388feac0e60ce1db4204da3ebbdd41b not found: ID does not exist" Oct 30 22:10:53.275775 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:53.275749 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566f4fb975-ql82z"] Oct 30 22:10:53.324831 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:53.324811 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-566f4fb975-ql82z"] Oct 30 22:10:53.538780 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:10:53.538746 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fa6ad72d-768e-41f5-a57b-5bd7c55979b2" path="/var/lib/kubelet/pods/fa6ad72d-768e-41f5-a57b-5bd7c55979b2/volumes" Oct 30 22:10:59.654308 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:10:59.654272 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:11:13.015674 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:11:13.015636 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:11:29.655884 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:11:29.655832 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:11:44.840807 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:11:44.840767 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:11:59.653329 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:11:59.653295 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:12:02.352621 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:02.352558 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:12:02.669739 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:02.669705 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:12:13.378873 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:13.378797 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:12:20.063769 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:20.063735 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:12:20.329940 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:20.329833 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:12:21.429922 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:21.429894 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm"] Oct 30 22:12:21.430346 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:21.430116 4497 cpu_manager.go:414] "containerMap: removing container" podUID="fa6ad72d-768e-41f5-a57b-5bd7c55979b2" containerName="console" Oct 30 22:12:21.430346 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:21.430126 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa6ad72d-768e-41f5-a57b-5bd7c55979b2" containerName="console" Oct 30 22:12:21.430346 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:21.430183 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa6ad72d-768e-41f5-a57b-5bd7c55979b2" containerName="console" Oct 30 22:12:21.432024 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:21.432009 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm" Oct 30 22:12:21.462449 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:21.462425 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbmms\" (UniqueName: \"kubernetes.io/projected/79adf8d1-1a38-4ce3-93af-9d802b711893-kube-api-access-vbmms\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm\" (UID: \"79adf8d1-1a38-4ce3-93af-9d802b711893\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm" Oct 30 22:12:21.462580 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:21.462485 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79adf8d1-1a38-4ce3-93af-9d802b711893-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm\" (UID: \"79adf8d1-1a38-4ce3-93af-9d802b711893\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm" Oct 30 22:12:21.462580 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:21.462510 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79adf8d1-1a38-4ce3-93af-9d802b711893-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm\" (UID: \"79adf8d1-1a38-4ce3-93af-9d802b711893\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm" Oct 30 22:12:21.485838 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:21.485808 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Oct 30 22:12:21.534674 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:21.534644 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"98a21a31f7a8ae0212b9c22cc643f9202bfa37-6b211c7f-dockercfg-jzj2n\"" Oct 30 22:12:21.534804 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:21.534785 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Oct 30 22:12:21.540880 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:21.540859 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm"] Oct 30 22:12:21.563269 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:21.563220 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79adf8d1-1a38-4ce3-93af-9d802b711893-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm\" (UID: \"79adf8d1-1a38-4ce3-93af-9d802b711893\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm" Oct 30 22:12:21.563269 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:21.563274 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79adf8d1-1a38-4ce3-93af-9d802b711893-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm\" (UID: \"79adf8d1-1a38-4ce3-93af-9d802b711893\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm" Oct 30 22:12:21.563407 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:21.563383 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbmms\" (UniqueName: \"kubernetes.io/projected/79adf8d1-1a38-4ce3-93af-9d802b711893-kube-api-access-vbmms\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm\" (UID: \"79adf8d1-1a38-4ce3-93af-9d802b711893\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm" Oct 30 22:12:21.563581 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:21.563563 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79adf8d1-1a38-4ce3-93af-9d802b711893-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm\" (UID: \"79adf8d1-1a38-4ce3-93af-9d802b711893\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm" Oct 30 22:12:21.563644 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:21.563626 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79adf8d1-1a38-4ce3-93af-9d802b711893-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm\" (UID: \"79adf8d1-1a38-4ce3-93af-9d802b711893\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm" Oct 30 22:12:21.626061 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:21.626029 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbmms\" (UniqueName: \"kubernetes.io/projected/79adf8d1-1a38-4ce3-93af-9d802b711893-kube-api-access-vbmms\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm\" (UID: \"79adf8d1-1a38-4ce3-93af-9d802b711893\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm" Oct 30 22:12:21.743372 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:21.743321 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm" Oct 30 22:12:22.112380 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:22.112357 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm"] Oct 30 22:12:22.115114 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:12:22.115079 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79adf8d1_1a38_4ce3_93af_9d802b711893.slice/crio-f12c8e8e3b2ca84f3a283becb549c37c012fc625f9a29a9c0a08e7f14a191551 WatchSource:0}: Error finding container f12c8e8e3b2ca84f3a283becb549c37c012fc625f9a29a9c0a08e7f14a191551: Status 404 returned error can't find the container with id f12c8e8e3b2ca84f3a283becb549c37c012fc625f9a29a9c0a08e7f14a191551 Oct 30 22:12:22.389757 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:22.389727 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm" event={"ID":"79adf8d1-1a38-4ce3-93af-9d802b711893","Type":"ContainerStarted","Data":"f12c8e8e3b2ca84f3a283becb549c37c012fc625f9a29a9c0a08e7f14a191551"} Oct 30 22:12:29.414890 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:29.414825 4497 generic.go:356] "Generic (PLEG): container finished" podID="79adf8d1-1a38-4ce3-93af-9d802b711893" containerID="084eb2e2bae69b67ce0658212dc818b6fcbde51d2cbc9751e954f9bdcb414273" exitCode=0 Oct 30 22:12:29.415208 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:29.414909 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm" event={"ID":"79adf8d1-1a38-4ce3-93af-9d802b711893","Type":"ContainerDied","Data":"084eb2e2bae69b67ce0658212dc818b6fcbde51d2cbc9751e954f9bdcb414273"} Oct 30 22:12:29.652929 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:12:29.652894 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:12:33.427711 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:33.427681 4497 generic.go:356] "Generic (PLEG): container finished" podID="79adf8d1-1a38-4ce3-93af-9d802b711893" containerID="4cbacb09a2fe0fda6e077708357df5daffc35ff3a968d85b3735fd4f73b4f4e1" exitCode=0 Oct 30 22:12:33.428142 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:33.427732 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm" event={"ID":"79adf8d1-1a38-4ce3-93af-9d802b711893","Type":"ContainerDied","Data":"4cbacb09a2fe0fda6e077708357df5daffc35ff3a968d85b3735fd4f73b4f4e1"} Oct 30 22:12:41.456339 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:41.456301 4497 generic.go:356] "Generic (PLEG): container finished" podID="79adf8d1-1a38-4ce3-93af-9d802b711893" containerID="31b59d7082f1a6afcf3cfa4ab31bdf0dc21c4070ce5024fccf6edfd127ac18b8" exitCode=0 Oct 30 22:12:41.456712 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:41.456387 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm" event={"ID":"79adf8d1-1a38-4ce3-93af-9d802b711893","Type":"ContainerDied","Data":"31b59d7082f1a6afcf3cfa4ab31bdf0dc21c4070ce5024fccf6edfd127ac18b8"} Oct 30 22:12:42.578410 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:42.578387 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm" Oct 30 22:12:42.614622 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:42.614601 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79adf8d1-1a38-4ce3-93af-9d802b711893-util\" (UniqueName: \"kubernetes.io/empty-dir/79adf8d1-1a38-4ce3-93af-9d802b711893-util\") pod \"79adf8d1-1a38-4ce3-93af-9d802b711893\" (UID: \"79adf8d1-1a38-4ce3-93af-9d802b711893\") " Oct 30 22:12:42.614680 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:42.614635 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79adf8d1-1a38-4ce3-93af-9d802b711893-bundle\" (UniqueName: \"kubernetes.io/empty-dir/79adf8d1-1a38-4ce3-93af-9d802b711893-bundle\") pod \"79adf8d1-1a38-4ce3-93af-9d802b711893\" (UID: \"79adf8d1-1a38-4ce3-93af-9d802b711893\") " Oct 30 22:12:42.614680 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:42.614665 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/79adf8d1-1a38-4ce3-93af-9d802b711893-kube-api-access-vbmms\" (UniqueName: \"kubernetes.io/projected/79adf8d1-1a38-4ce3-93af-9d802b711893-kube-api-access-vbmms\") pod \"79adf8d1-1a38-4ce3-93af-9d802b711893\" (UID: \"79adf8d1-1a38-4ce3-93af-9d802b711893\") " Oct 30 22:12:42.615316 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:42.615295 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79adf8d1-1a38-4ce3-93af-9d802b711893-bundle" pod "79adf8d1-1a38-4ce3-93af-9d802b711893" (UID: "79adf8d1-1a38-4ce3-93af-9d802b711893"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:12:42.616857 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:42.616831 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79adf8d1-1a38-4ce3-93af-9d802b711893-kube-api-access-vbmms" pod "79adf8d1-1a38-4ce3-93af-9d802b711893" (UID: "79adf8d1-1a38-4ce3-93af-9d802b711893"). InnerVolumeSpecName "kube-api-access-vbmms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:12:42.618594 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:42.618574 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79adf8d1-1a38-4ce3-93af-9d802b711893-util" pod "79adf8d1-1a38-4ce3-93af-9d802b711893" (UID: "79adf8d1-1a38-4ce3-93af-9d802b711893"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:12:42.715289 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:42.715219 4497 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79adf8d1-1a38-4ce3-93af-9d802b711893-util\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:12:42.715289 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:42.715262 4497 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79adf8d1-1a38-4ce3-93af-9d802b711893-bundle\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:12:42.715289 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:42.715272 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbmms\" (UniqueName: \"kubernetes.io/projected/79adf8d1-1a38-4ce3-93af-9d802b711893-kube-api-access-vbmms\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:12:43.464483 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:43.464447 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm" event={"ID":"79adf8d1-1a38-4ce3-93af-9d802b711893","Type":"ContainerDied","Data":"f12c8e8e3b2ca84f3a283becb549c37c012fc625f9a29a9c0a08e7f14a191551"} Oct 30 22:12:43.464646 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:43.464496 4497 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f12c8e8e3b2ca84f3a283becb549c37c012fc625f9a29a9c0a08e7f14a191551" Oct 30 22:12:43.464646 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:43.464459 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820c996gm" Oct 30 22:12:48.718256 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:48.718203 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:12:50.042856 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.042824 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-lrhbv"] Oct 30 22:12:50.043301 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.043056 4497 cpu_manager.go:414] "containerMap: removing container" podUID="79adf8d1-1a38-4ce3-93af-9d802b711893" containerName="pull" Oct 30 22:12:50.043301 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.043067 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="79adf8d1-1a38-4ce3-93af-9d802b711893" containerName="pull" Oct 30 22:12:50.043301 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.043075 4497 cpu_manager.go:414] "containerMap: removing container" podUID="79adf8d1-1a38-4ce3-93af-9d802b711893" containerName="extract" Oct 30 22:12:50.043301 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.043081 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="79adf8d1-1a38-4ce3-93af-9d802b711893" containerName="extract" Oct 30 22:12:50.043301 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.043100 4497 cpu_manager.go:414] "containerMap: removing container" podUID="79adf8d1-1a38-4ce3-93af-9d802b711893" containerName="util" Oct 30 22:12:50.043301 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.043104 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="79adf8d1-1a38-4ce3-93af-9d802b711893" containerName="util" Oct 30 22:12:50.043301 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.043150 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="79adf8d1-1a38-4ce3-93af-9d802b711893" containerName="extract" Oct 30 22:12:50.044758 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.044742 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-lrhbv" Oct 30 22:12:50.098209 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.098183 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Oct 30 22:12:50.098439 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.098418 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-zb75q\"" Oct 30 22:12:50.147269 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.147233 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Oct 30 22:12:50.147345 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.147291 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Oct 30 22:12:50.154439 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.154413 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-lrhbv"] Oct 30 22:12:50.160694 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.160664 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqb8r\" (UniqueName: \"kubernetes.io/projected/ff177cbf-37d7-48b4-9c1d-d8b965762642-kube-api-access-rqb8r\") pod \"custom-metrics-autoscaler-operator-c667576c8-lrhbv\" (UID: \"ff177cbf-37d7-48b4-9c1d-d8b965762642\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-lrhbv" Oct 30 22:12:50.160820 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.160799 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/ff177cbf-37d7-48b4-9c1d-d8b965762642-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-lrhbv\" (UID: \"ff177cbf-37d7-48b4-9c1d-d8b965762642\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-lrhbv" Oct 30 22:12:50.261597 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.261574 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/ff177cbf-37d7-48b4-9c1d-d8b965762642-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-lrhbv\" (UID: \"ff177cbf-37d7-48b4-9c1d-d8b965762642\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-lrhbv" Oct 30 22:12:50.261698 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.261629 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqb8r\" (UniqueName: \"kubernetes.io/projected/ff177cbf-37d7-48b4-9c1d-d8b965762642-kube-api-access-rqb8r\") pod \"custom-metrics-autoscaler-operator-c667576c8-lrhbv\" (UID: \"ff177cbf-37d7-48b4-9c1d-d8b965762642\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-lrhbv" Oct 30 22:12:50.263955 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.263934 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/ff177cbf-37d7-48b4-9c1d-d8b965762642-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-lrhbv\" (UID: \"ff177cbf-37d7-48b4-9c1d-d8b965762642\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-lrhbv" Oct 30 22:12:50.368908 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.368855 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqb8r\" (UniqueName: \"kubernetes.io/projected/ff177cbf-37d7-48b4-9c1d-d8b965762642-kube-api-access-rqb8r\") pod \"custom-metrics-autoscaler-operator-c667576c8-lrhbv\" (UID: \"ff177cbf-37d7-48b4-9c1d-d8b965762642\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-lrhbv" Oct 30 22:12:50.441726 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.441699 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:12:50.655910 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:50.655875 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-lrhbv" Oct 30 22:12:51.139714 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:51.139557 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-lrhbv"] Oct 30 22:12:51.142616 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:12:51.142590 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff177cbf_37d7_48b4_9c1d_d8b965762642.slice/crio-7e7f0a8b1424cd6640f8019b286e39d5ea51daa02a30654b5a07f903f97c5a45 WatchSource:0}: Error finding container 7e7f0a8b1424cd6640f8019b286e39d5ea51daa02a30654b5a07f903f97c5a45: Status 404 returned error can't find the container with id 7e7f0a8b1424cd6640f8019b286e39d5ea51daa02a30654b5a07f903f97c5a45 Oct 30 22:12:51.491892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:51.491817 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-lrhbv" event={"ID":"ff177cbf-37d7-48b4-9c1d-d8b965762642","Type":"ContainerStarted","Data":"7e7f0a8b1424cd6640f8019b286e39d5ea51daa02a30654b5a07f903f97c5a45"} Oct 30 22:12:55.507292 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:55.507255 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-lrhbv" event={"ID":"ff177cbf-37d7-48b4-9c1d-d8b965762642","Type":"ContainerStarted","Data":"75dd355aaf74473c7212eaa2e92a6d5f2454cff0c1ee540022d9d47d81f1023b"} Oct 30 22:12:55.507668 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:55.507334 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-lrhbv" Oct 30 22:12:55.727168 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:55.727115 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-lrhbv" podStartSLOduration=2.575815453 podStartE2EDuration="6.727103506s" totalImagesPullingTime="4.151288053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:12:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:12:55.676465055 +0000 UTC m=+270.303530619" watchObservedRunningTime="2026-10-30 22:12:55.727103506 +0000 UTC m=+270.354169057" Oct 30 22:12:56.597050 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:56.597013 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:12:58.335991 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:58.335955 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-7dc85965f-9vvhg"] Oct 30 22:12:58.338018 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:58.337998 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-7dc85965f-9vvhg" Oct 30 22:12:58.367588 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:58.367557 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:12:58.392815 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:58.392793 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Oct 30 22:12:58.418153 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:58.418133 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/11b814d1-e2cf-4407-a531-6a23f12d5c99-cabundle0\") pod \"keda-operator-7dc85965f-9vvhg\" (UID: \"11b814d1-e2cf-4407-a531-6a23f12d5c99\") " pod="openshift-keda/keda-operator-7dc85965f-9vvhg" Oct 30 22:12:58.418257 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:58.418160 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r6dm\" (UniqueName: \"kubernetes.io/projected/11b814d1-e2cf-4407-a531-6a23f12d5c99-kube-api-access-6r6dm\") pod \"keda-operator-7dc85965f-9vvhg\" (UID: \"11b814d1-e2cf-4407-a531-6a23f12d5c99\") " pod="openshift-keda/keda-operator-7dc85965f-9vvhg" Oct 30 22:12:58.418257 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:58.418194 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/11b814d1-e2cf-4407-a531-6a23f12d5c99-certificates\") pod \"keda-operator-7dc85965f-9vvhg\" (UID: \"11b814d1-e2cf-4407-a531-6a23f12d5c99\") " pod="openshift-keda/keda-operator-7dc85965f-9vvhg" Oct 30 22:12:58.441522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:58.441493 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-4h588\"" Oct 30 22:12:58.441522 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:58.441518 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Oct 30 22:12:58.442667 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:58.442647 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-7dc85965f-9vvhg"] Oct 30 22:12:58.519135 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:58.519111 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/11b814d1-e2cf-4407-a531-6a23f12d5c99-cabundle0\") pod \"keda-operator-7dc85965f-9vvhg\" (UID: \"11b814d1-e2cf-4407-a531-6a23f12d5c99\") " pod="openshift-keda/keda-operator-7dc85965f-9vvhg" Oct 30 22:12:58.519222 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:58.519137 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r6dm\" (UniqueName: \"kubernetes.io/projected/11b814d1-e2cf-4407-a531-6a23f12d5c99-kube-api-access-6r6dm\") pod \"keda-operator-7dc85965f-9vvhg\" (UID: \"11b814d1-e2cf-4407-a531-6a23f12d5c99\") " pod="openshift-keda/keda-operator-7dc85965f-9vvhg" Oct 30 22:12:58.519222 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:58.519171 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/11b814d1-e2cf-4407-a531-6a23f12d5c99-certificates\") pod \"keda-operator-7dc85965f-9vvhg\" (UID: \"11b814d1-e2cf-4407-a531-6a23f12d5c99\") " pod="openshift-keda/keda-operator-7dc85965f-9vvhg" Oct 30 22:12:58.519368 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:12:58.519226 4497 configmap.go:193] Couldn't get configMap openshift-keda/keda-ocp-cabundle: configmap "keda-ocp-cabundle" not found Oct 30 22:12:58.519368 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:12:58.519288 4497 secret.go:281] references non-existent secret key: ca.crt Oct 30 22:12:58.519368 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:12:58.519304 4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11b814d1-e2cf-4407-a531-6a23f12d5c99-cabundle0 podName:11b814d1-e2cf-4407-a531-6a23f12d5c99 nodeName:}" failed. No retries permitted until 2026-10-30 22:12:59.019287592 +0000 UTC m=+273.646353119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cabundle0" (UniqueName: "kubernetes.io/configmap/11b814d1-e2cf-4407-a531-6a23f12d5c99-cabundle0") pod "keda-operator-7dc85965f-9vvhg" (UID: "11b814d1-e2cf-4407-a531-6a23f12d5c99") : configmap "keda-ocp-cabundle" not found Oct 30 22:12:58.519368 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:12:58.519303 4497 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Oct 30 22:12:58.519368 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:12:58.519322 4497 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-7dc85965f-9vvhg: references non-existent secret key: ca.crt Oct 30 22:12:58.519368 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:12:58.519370 4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11b814d1-e2cf-4407-a531-6a23f12d5c99-certificates podName:11b814d1-e2cf-4407-a531-6a23f12d5c99 nodeName:}" failed. No retries permitted until 2026-10-30 22:12:59.01935405 +0000 UTC m=+273.646419606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/11b814d1-e2cf-4407-a531-6a23f12d5c99-certificates") pod "keda-operator-7dc85965f-9vvhg" (UID: "11b814d1-e2cf-4407-a531-6a23f12d5c99") : references non-existent secret key: ca.crt Oct 30 22:12:58.583220 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:58.583189 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r6dm\" (UniqueName: \"kubernetes.io/projected/11b814d1-e2cf-4407-a531-6a23f12d5c99-kube-api-access-6r6dm\") pod \"keda-operator-7dc85965f-9vvhg\" (UID: \"11b814d1-e2cf-4407-a531-6a23f12d5c99\") " pod="openshift-keda/keda-operator-7dc85965f-9vvhg" Oct 30 22:12:58.683428 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:58.683404 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:12:59.023466 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.023400 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/11b814d1-e2cf-4407-a531-6a23f12d5c99-cabundle0\") pod \"keda-operator-7dc85965f-9vvhg\" (UID: \"11b814d1-e2cf-4407-a531-6a23f12d5c99\") " pod="openshift-keda/keda-operator-7dc85965f-9vvhg" Oct 30 22:12:59.023466 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.023461 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/11b814d1-e2cf-4407-a531-6a23f12d5c99-certificates\") pod \"keda-operator-7dc85965f-9vvhg\" (UID: \"11b814d1-e2cf-4407-a531-6a23f12d5c99\") " pod="openshift-keda/keda-operator-7dc85965f-9vvhg" Oct 30 22:12:59.024004 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.023985 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/11b814d1-e2cf-4407-a531-6a23f12d5c99-cabundle0\") pod \"keda-operator-7dc85965f-9vvhg\" (UID: \"11b814d1-e2cf-4407-a531-6a23f12d5c99\") " pod="openshift-keda/keda-operator-7dc85965f-9vvhg" Oct 30 22:12:59.025935 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.025917 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/11b814d1-e2cf-4407-a531-6a23f12d5c99-certificates\") pod \"keda-operator-7dc85965f-9vvhg\" (UID: \"11b814d1-e2cf-4407-a531-6a23f12d5c99\") " pod="openshift-keda/keda-operator-7dc85965f-9vvhg" Oct 30 22:12:59.248416 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.248386 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-7dc85965f-9vvhg" Oct 30 22:12:59.354029 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.354002 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-86bd856cfb-zmhfq"] Oct 30 22:12:59.355962 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.355934 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-zmhfq" Oct 30 22:12:59.393074 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.393050 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:12:59.410266 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.410232 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Oct 30 22:12:59.418962 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.418940 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-86bd856cfb-zmhfq"] Oct 30 22:12:59.426189 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.426159 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9578a6ae-2421-45f5-856e-cd7e0e00d353-certificates\") pod \"keda-metrics-apiserver-86bd856cfb-zmhfq\" (UID: \"9578a6ae-2421-45f5-856e-cd7e0e00d353\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-zmhfq" Oct 30 22:12:59.426304 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.426199 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66nvq\" (UniqueName: \"kubernetes.io/projected/9578a6ae-2421-45f5-856e-cd7e0e00d353-kube-api-access-66nvq\") pod \"keda-metrics-apiserver-86bd856cfb-zmhfq\" (UID: \"9578a6ae-2421-45f5-856e-cd7e0e00d353\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-zmhfq" Oct 30 22:12:59.426304 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.426288 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/9578a6ae-2421-45f5-856e-cd7e0e00d353-temp-vol\") pod \"keda-metrics-apiserver-86bd856cfb-zmhfq\" (UID: \"9578a6ae-2421-45f5-856e-cd7e0e00d353\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-zmhfq" Oct 30 22:12:59.527274 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.527252 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66nvq\" (UniqueName: \"kubernetes.io/projected/9578a6ae-2421-45f5-856e-cd7e0e00d353-kube-api-access-66nvq\") pod \"keda-metrics-apiserver-86bd856cfb-zmhfq\" (UID: \"9578a6ae-2421-45f5-856e-cd7e0e00d353\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-zmhfq" Oct 30 22:12:59.527373 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.527300 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/9578a6ae-2421-45f5-856e-cd7e0e00d353-temp-vol\") pod \"keda-metrics-apiserver-86bd856cfb-zmhfq\" (UID: \"9578a6ae-2421-45f5-856e-cd7e0e00d353\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-zmhfq" Oct 30 22:12:59.527373 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.527333 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9578a6ae-2421-45f5-856e-cd7e0e00d353-certificates\") pod \"keda-metrics-apiserver-86bd856cfb-zmhfq\" (UID: \"9578a6ae-2421-45f5-856e-cd7e0e00d353\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-zmhfq" Oct 30 22:12:59.527707 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.527687 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/9578a6ae-2421-45f5-856e-cd7e0e00d353-temp-vol\") pod \"keda-metrics-apiserver-86bd856cfb-zmhfq\" (UID: \"9578a6ae-2421-45f5-856e-cd7e0e00d353\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-zmhfq" Oct 30 22:12:59.529713 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.529694 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9578a6ae-2421-45f5-856e-cd7e0e00d353-certificates\") pod \"keda-metrics-apiserver-86bd856cfb-zmhfq\" (UID: \"9578a6ae-2421-45f5-856e-cd7e0e00d353\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-zmhfq" Oct 30 22:12:59.589377 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.589321 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66nvq\" (UniqueName: \"kubernetes.io/projected/9578a6ae-2421-45f5-856e-cd7e0e00d353-kube-api-access-66nvq\") pod \"keda-metrics-apiserver-86bd856cfb-zmhfq\" (UID: \"9578a6ae-2421-45f5-856e-cd7e0e00d353\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-zmhfq" Oct 30 22:12:59.615742 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.615724 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-7dc85965f-9vvhg"] Oct 30 22:12:59.618682 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:12:59.618660 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b814d1_e2cf_4407_a531_6a23f12d5c99.slice/crio-874bdc2b402d534b37aa3d2050a21d1f2c76dfbda3e77fa62865a8a6a1e70d9c WatchSource:0}: Error finding container 874bdc2b402d534b37aa3d2050a21d1f2c76dfbda3e77fa62865a8a6a1e70d9c: Status 404 returned error can't find the container with id 874bdc2b402d534b37aa3d2050a21d1f2c76dfbda3e77fa62865a8a6a1e70d9c Oct 30 22:12:59.653852 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:12:59.653822 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:12:59.668177 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.668160 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-zmhfq" Oct 30 22:12:59.709903 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.709874 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:12:59.979403 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:12:59.979375 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:13:00.034581 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:00.034556 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-86bd856cfb-zmhfq"] Oct 30 22:13:00.037365 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:13:00.037338 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9578a6ae_2421_45f5_856e_cd7e0e00d353.slice/crio-2f9dfcd6a003959b4e95114ee608ce675cd08c295321647858440ebf7ed3fb23 WatchSource:0}: Error finding container 2f9dfcd6a003959b4e95114ee608ce675cd08c295321647858440ebf7ed3fb23: Status 404 returned error can't find the container with id 2f9dfcd6a003959b4e95114ee608ce675cd08c295321647858440ebf7ed3fb23 Oct 30 22:13:00.243479 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:00.243419 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:13:00.519019 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:00.518919 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:13:00.523721 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:00.523696 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-7dc85965f-9vvhg" event={"ID":"11b814d1-e2cf-4407-a531-6a23f12d5c99","Type":"ContainerStarted","Data":"874bdc2b402d534b37aa3d2050a21d1f2c76dfbda3e77fa62865a8a6a1e70d9c"} Oct 30 22:13:00.524776 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:00.524754 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-zmhfq" event={"ID":"9578a6ae-2421-45f5-856e-cd7e0e00d353","Type":"ContainerStarted","Data":"2f9dfcd6a003959b4e95114ee608ce675cd08c295321647858440ebf7ed3fb23"} Oct 30 22:13:02.506355 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:02.506311 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:13:03.534587 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:03.534486 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:13:04.047635 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:04.047598 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:13:04.375727 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:04.375563 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:13:05.546777 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:05.546739 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-7dc85965f-9vvhg" event={"ID":"11b814d1-e2cf-4407-a531-6a23f12d5c99","Type":"ContainerStarted","Data":"aa7e12f0d59f94ed41cf10d950ecd4623e0718c72625aa02d5fc8fdba1cdc2bf"} Oct 30 22:13:05.547254 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:05.546809 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-7dc85965f-9vvhg" Oct 30 22:13:05.548504 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:05.548478 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-zmhfq" event={"ID":"9578a6ae-2421-45f5-856e-cd7e0e00d353","Type":"ContainerStarted","Data":"493322f608392375cca2b12de12990366663531b46252ef3de077686a877c980"} Oct 30 22:13:05.548632 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:05.548622 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-zmhfq" Oct 30 22:13:05.663995 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:05.663792 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/keda-operator-7dc85965f-9vvhg" podStartSLOduration=2.618676019 podStartE2EDuration="7.663774019s" totalImagesPullingTime="5.045098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:13:05.663182389 +0000 UTC m=+280.290247940" watchObservedRunningTime="2026-10-30 22:13:05.663774019 +0000 UTC m=+280.290839571" Oct 30 22:13:05.780652 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:05.780597 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-zmhfq" podStartSLOduration=2.15479733 podStartE2EDuration="6.780579845s" totalImagesPullingTime="4.625782515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:12:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:13:05.780339635 +0000 UTC m=+280.407405185" watchObservedRunningTime="2026-10-30 22:13:05.780579845 +0000 UTC m=+280.407645409" Oct 30 22:13:13.719655 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:13.719570 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:13:16.513263 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:16.513217 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-lrhbv" Oct 30 22:13:16.556853 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:16.556831 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-zmhfq" Oct 30 22:13:26.555661 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:26.555630 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-7dc85965f-9vvhg" Oct 30 22:13:29.653940 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:13:29.653908 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:13:48.534839 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:48.534752 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:13:48.869449 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:48.869361 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:13:58.984369 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:13:58.984322 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:13:59.654870 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:13:59.654838 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:14:14.074732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:14.074682 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:14:23.490079 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.490047 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:14:23.527997 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.527974 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-86c86ffb6b-nmhlp"] Oct 30 22:14:23.529857 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.529843 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-86c86ffb6b-nmhlp" Oct 30 22:14:23.572377 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.572351 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-xxp8t"] Oct 30 22:14:23.574613 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.574591 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-78bb9c6ff8-xxp8t" Oct 30 22:14:23.599441 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.599417 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ddeead21-bfc0-4438-9025-cd19ec6252ea-data\") pod \"seaweedfs-78bb9c6ff8-xxp8t\" (UID: \"ddeead21-bfc0-4438-9025-cd19ec6252ea\") " pod="kserve/seaweedfs-78bb9c6ff8-xxp8t" Oct 30 22:14:23.599537 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.599477 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh8s8\" (UniqueName: \"kubernetes.io/projected/ddeead21-bfc0-4438-9025-cd19ec6252ea-kube-api-access-gh8s8\") pod \"seaweedfs-78bb9c6ff8-xxp8t\" (UID: \"ddeead21-bfc0-4438-9025-cd19ec6252ea\") " pod="kserve/seaweedfs-78bb9c6ff8-xxp8t" Oct 30 22:14:23.599609 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.599584 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zfz9\" (UniqueName: \"kubernetes.io/projected/fdd4d81b-240f-4cc4-a2a7-4b45d6a14e28-kube-api-access-7zfz9\") pod \"llmisvc-controller-manager-86c86ffb6b-nmhlp\" (UID: \"fdd4d81b-240f-4cc4-a2a7-4b45d6a14e28\") " pod="kserve/llmisvc-controller-manager-86c86ffb6b-nmhlp" Oct 30 22:14:23.599698 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.599623 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdd4d81b-240f-4cc4-a2a7-4b45d6a14e28-cert\") pod \"llmisvc-controller-manager-86c86ffb6b-nmhlp\" (UID: \"fdd4d81b-240f-4cc4-a2a7-4b45d6a14e28\") " pod="kserve/llmisvc-controller-manager-86c86ffb6b-nmhlp" Oct 30 22:14:23.601527 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.601507 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-86c86ffb6b-nmhlp"] Oct 30 22:14:23.634021 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.633996 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Oct 30 22:14:23.634404 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.634366 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-vf6ms\"" Oct 30 22:14:23.634514 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.634408 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Oct 30 22:14:23.634514 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.634459 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-lzqct\"" Oct 30 22:14:23.637053 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.637038 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Oct 30 22:14:23.637126 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.637062 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Oct 30 22:14:23.685892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.685869 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-xxp8t"] Oct 30 22:14:23.700031 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.700006 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zfz9\" (UniqueName: \"kubernetes.io/projected/fdd4d81b-240f-4cc4-a2a7-4b45d6a14e28-kube-api-access-7zfz9\") pod \"llmisvc-controller-manager-86c86ffb6b-nmhlp\" (UID: \"fdd4d81b-240f-4cc4-a2a7-4b45d6a14e28\") " pod="kserve/llmisvc-controller-manager-86c86ffb6b-nmhlp" Oct 30 22:14:23.700130 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.700044 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdd4d81b-240f-4cc4-a2a7-4b45d6a14e28-cert\") pod \"llmisvc-controller-manager-86c86ffb6b-nmhlp\" (UID: \"fdd4d81b-240f-4cc4-a2a7-4b45d6a14e28\") " pod="kserve/llmisvc-controller-manager-86c86ffb6b-nmhlp" Oct 30 22:14:23.700130 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.700093 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ddeead21-bfc0-4438-9025-cd19ec6252ea-data\") pod \"seaweedfs-78bb9c6ff8-xxp8t\" (UID: \"ddeead21-bfc0-4438-9025-cd19ec6252ea\") " pod="kserve/seaweedfs-78bb9c6ff8-xxp8t" Oct 30 22:14:23.700130 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.700126 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh8s8\" (UniqueName: \"kubernetes.io/projected/ddeead21-bfc0-4438-9025-cd19ec6252ea-kube-api-access-gh8s8\") pod \"seaweedfs-78bb9c6ff8-xxp8t\" (UID: \"ddeead21-bfc0-4438-9025-cd19ec6252ea\") " pod="kserve/seaweedfs-78bb9c6ff8-xxp8t" Oct 30 22:14:23.700485 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.700457 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ddeead21-bfc0-4438-9025-cd19ec6252ea-data\") pod \"seaweedfs-78bb9c6ff8-xxp8t\" (UID: \"ddeead21-bfc0-4438-9025-cd19ec6252ea\") " pod="kserve/seaweedfs-78bb9c6ff8-xxp8t" Oct 30 22:14:23.702635 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.702617 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdd4d81b-240f-4cc4-a2a7-4b45d6a14e28-cert\") pod \"llmisvc-controller-manager-86c86ffb6b-nmhlp\" (UID: \"fdd4d81b-240f-4cc4-a2a7-4b45d6a14e28\") " pod="kserve/llmisvc-controller-manager-86c86ffb6b-nmhlp" Oct 30 22:14:23.763656 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.763596 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh8s8\" (UniqueName: \"kubernetes.io/projected/ddeead21-bfc0-4438-9025-cd19ec6252ea-kube-api-access-gh8s8\") pod \"seaweedfs-78bb9c6ff8-xxp8t\" (UID: \"ddeead21-bfc0-4438-9025-cd19ec6252ea\") " pod="kserve/seaweedfs-78bb9c6ff8-xxp8t" Oct 30 22:14:23.763806 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.763789 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zfz9\" (UniqueName: \"kubernetes.io/projected/fdd4d81b-240f-4cc4-a2a7-4b45d6a14e28-kube-api-access-7zfz9\") pod \"llmisvc-controller-manager-86c86ffb6b-nmhlp\" (UID: \"fdd4d81b-240f-4cc4-a2a7-4b45d6a14e28\") " pod="kserve/llmisvc-controller-manager-86c86ffb6b-nmhlp" Oct 30 22:14:23.821777 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.821747 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:14:23.841703 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.841677 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-86c86ffb6b-nmhlp" Oct 30 22:14:23.883983 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:23.883950 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-78bb9c6ff8-xxp8t" Oct 30 22:14:24.132580 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:24.132549 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:14:24.210319 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:24.210300 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-86c86ffb6b-nmhlp"] Oct 30 22:14:24.212674 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:14:24.212646 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdd4d81b_240f_4cc4_a2a7_4b45d6a14e28.slice/crio-ea9a2a8eb7dd43a0e00c65635d4ec94aa80aa5c0ba6061e72e204ac8d6e7ae7d WatchSource:0}: Error finding container ea9a2a8eb7dd43a0e00c65635d4ec94aa80aa5c0ba6061e72e204ac8d6e7ae7d: Status 404 returned error can't find the container with id ea9a2a8eb7dd43a0e00c65635d4ec94aa80aa5c0ba6061e72e204ac8d6e7ae7d Oct 30 22:14:24.213890 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:24.213872 4497 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:14:24.259779 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:24.259760 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-xxp8t"] Oct 30 22:14:24.261911 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:14:24.261888 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddeead21_bfc0_4438_9025_cd19ec6252ea.slice/crio-84f5f41ab5009f169354cb6118eb2fcfdad3a02fd97692558092701395691d3e WatchSource:0}: Error finding container 84f5f41ab5009f169354cb6118eb2fcfdad3a02fd97692558092701395691d3e: Status 404 returned error can't find the container with id 84f5f41ab5009f169354cb6118eb2fcfdad3a02fd97692558092701395691d3e Oct 30 22:14:24.830445 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:24.830405 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-78bb9c6ff8-xxp8t" event={"ID":"ddeead21-bfc0-4438-9025-cd19ec6252ea","Type":"ContainerStarted","Data":"84f5f41ab5009f169354cb6118eb2fcfdad3a02fd97692558092701395691d3e"} Oct 30 22:14:24.831692 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:24.831667 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-86c86ffb6b-nmhlp" event={"ID":"fdd4d81b-240f-4cc4-a2a7-4b45d6a14e28","Type":"ContainerStarted","Data":"ea9a2a8eb7dd43a0e00c65635d4ec94aa80aa5c0ba6061e72e204ac8d6e7ae7d"} Oct 30 22:14:25.356410 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:25.356366 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:14:25.971250 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:25.971199 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:14:27.741964 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:27.741935 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Oct 30 22:14:27.845786 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:27.845753 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-78bb9c6ff8-xxp8t" event={"ID":"ddeead21-bfc0-4438-9025-cd19ec6252ea","Type":"ContainerStarted","Data":"9524e44089d334e1a5c430df456ad657d59e9aa0c52f4fff4807525624e4e307"} Oct 30 22:14:27.845926 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:27.845906 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-78bb9c6ff8-xxp8t" Oct 30 22:14:28.008006 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:28.007920 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/seaweedfs-78bb9c6ff8-xxp8t" podStartSLOduration=1.581275485 podStartE2EDuration="5.007907693s" totalImagesPullingTime="3.426632208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:28.007403247 +0000 UTC m=+362.634468798" watchObservedRunningTime="2026-10-30 22:14:28.007907693 +0000 UTC m=+362.634973240" Oct 30 22:14:29.652867 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:14:29.652837 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:14:32.863851 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:32.863820 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-86c86ffb6b-nmhlp" event={"ID":"fdd4d81b-240f-4cc4-a2a7-4b45d6a14e28","Type":"ContainerStarted","Data":"10d700fccada1772be09f77cfa5203a02413c7e1a5d7ceb15af8eec38816cf2e"} Oct 30 22:14:32.864219 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:32.864082 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-86c86ffb6b-nmhlp" Oct 30 22:14:32.981292 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:32.981186 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-86c86ffb6b-nmhlp" podStartSLOduration=1.541904114 podStartE2EDuration="9.981174732s" totalImagesPullingTime="8.439270618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:32.980462913 +0000 UTC m=+367.607528463" watchObservedRunningTime="2026-10-30 22:14:32.981174732 +0000 UTC m=+367.608240281" Oct 30 22:14:33.852047 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:33.852019 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-78bb9c6ff8-xxp8t" Oct 30 22:14:45.122997 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:14:45.122955 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:14:59.656638 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:14:59.656593 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:15:03.868476 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:15:03.868446 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-86c86ffb6b-nmhlp" Oct 30 22:15:14.472685 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:15:14.472604 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:29.654299 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:15:29.654258 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:15:47.255502 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:15:47.255467 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:56.892766 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:15:56.892728 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:57.213020 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:15:57.212937 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:57.483658 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:15:57.483581 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:59.654222 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:15:59.654184 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:16:02.109845 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:16:02.109808 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:02.457353 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:16:02.457325 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:14.828056 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:16:14.828003 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:29.656070 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:16:29.656031 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:16:56.630732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:16:56.630626 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:56.962609 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:16:56.962525 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:59.653791 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:16:59.653753 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:17:15.111953 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:17:15.111922 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:17:29.653656 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:17:29.653621 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:17:56.177404 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:17:56.177371 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-64cc6669cb-74z68"] Oct 30 22:17:56.180448 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:17:56.180431 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-64cc6669cb-74z68" Oct 30 22:17:56.234058 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:17:56.234038 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Oct 30 22:17:56.240423 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:17:56.240401 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-64cc6669cb-74z68"] Oct 30 22:17:56.282957 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:17:56.282936 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:17:56.330107 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:17:56.330083 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9678f4ef-361b-46ef-9d58-af00d81ee98d-data\") pod \"seaweedfs-tls-custom-64cc6669cb-74z68\" (UID: \"9678f4ef-361b-46ef-9d58-af00d81ee98d\") " pod="kserve/seaweedfs-tls-custom-64cc6669cb-74z68" Oct 30 22:17:56.330190 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:17:56.330127 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5mfz\" (UniqueName: \"kubernetes.io/projected/9678f4ef-361b-46ef-9d58-af00d81ee98d-kube-api-access-g5mfz\") pod \"seaweedfs-tls-custom-64cc6669cb-74z68\" (UID: \"9678f4ef-361b-46ef-9d58-af00d81ee98d\") " pod="kserve/seaweedfs-tls-custom-64cc6669cb-74z68" Oct 30 22:17:56.430527 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:17:56.430478 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5mfz\" (UniqueName: \"kubernetes.io/projected/9678f4ef-361b-46ef-9d58-af00d81ee98d-kube-api-access-g5mfz\") pod \"seaweedfs-tls-custom-64cc6669cb-74z68\" (UID: \"9678f4ef-361b-46ef-9d58-af00d81ee98d\") " pod="kserve/seaweedfs-tls-custom-64cc6669cb-74z68" Oct 30 22:17:56.430527 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:17:56.430522 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9678f4ef-361b-46ef-9d58-af00d81ee98d-data\") pod \"seaweedfs-tls-custom-64cc6669cb-74z68\" (UID: \"9678f4ef-361b-46ef-9d58-af00d81ee98d\") " pod="kserve/seaweedfs-tls-custom-64cc6669cb-74z68" Oct 30 22:17:56.430868 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:17:56.430850 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9678f4ef-361b-46ef-9d58-af00d81ee98d-data\") pod \"seaweedfs-tls-custom-64cc6669cb-74z68\" (UID: \"9678f4ef-361b-46ef-9d58-af00d81ee98d\") " pod="kserve/seaweedfs-tls-custom-64cc6669cb-74z68" Oct 30 22:17:56.500281 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:17:56.500252 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5mfz\" (UniqueName: \"kubernetes.io/projected/9678f4ef-361b-46ef-9d58-af00d81ee98d-kube-api-access-g5mfz\") pod \"seaweedfs-tls-custom-64cc6669cb-74z68\" (UID: \"9678f4ef-361b-46ef-9d58-af00d81ee98d\") " pod="kserve/seaweedfs-tls-custom-64cc6669cb-74z68" Oct 30 22:17:56.791732 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:17:56.791682 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-64cc6669cb-74z68" Oct 30 22:17:57.162310 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:17:57.162273 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-64cc6669cb-74z68"] Oct 30 22:17:57.164986 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:17:57.164959 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9678f4ef_361b_46ef_9d58_af00d81ee98d.slice/crio-340c3ad5dc8e88e259f90d080f4bee84def6f7c57db6bb80316e5c8883fa6b83 WatchSource:0}: Error finding container 340c3ad5dc8e88e259f90d080f4bee84def6f7c57db6bb80316e5c8883fa6b83: Status 404 returned error can't find the container with id 340c3ad5dc8e88e259f90d080f4bee84def6f7c57db6bb80316e5c8883fa6b83 Oct 30 22:17:57.632738 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:17:57.632704 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-64cc6669cb-74z68" event={"ID":"9678f4ef-361b-46ef-9d58-af00d81ee98d","Type":"ContainerStarted","Data":"340c3ad5dc8e88e259f90d080f4bee84def6f7c57db6bb80316e5c8883fa6b83"} Oct 30 22:17:58.638648 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:17:58.638612 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-64cc6669cb-74z68" event={"ID":"9678f4ef-361b-46ef-9d58-af00d81ee98d","Type":"ContainerStarted","Data":"c394281df7e09cdea35eea92d6e6dcbbc16f26f29354af3f0ec2e37e2a5c447e"} Oct 30 22:17:58.754792 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:17:58.754740 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-64cc6669cb-74z68" podStartSLOduration=1.9968919330000001 podStartE2EDuration="2.75472641s" totalImagesPullingTime="757.834477ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:17:58.75366755 +0000 UTC m=+573.380733100" watchObservedRunningTime="2026-10-30 22:17:58.75472641 +0000 UTC m=+573.381791961" Oct 30 22:17:59.654985 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:17:59.654947 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:18:00.440772 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:00.440741 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-64cc6669cb-74z68"] Oct 30 22:18:00.652228 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:00.652170 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="kserve/seaweedfs-tls-custom-64cc6669cb-74z68" podUID="9678f4ef-361b-46ef-9d58-af00d81ee98d" containerName="seaweedfs-tls-custom" containerID="cri-o://c394281df7e09cdea35eea92d6e6dcbbc16f26f29354af3f0ec2e37e2a5c447e" gracePeriod=30 Oct 30 22:18:01.886078 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:01.886056 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-64cc6669cb-74z68" Oct 30 22:18:02.053222 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.053151 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-685c9f986c-fdcpx"] Oct 30 22:18:02.053559 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.053540 4497 cpu_manager.go:414] "containerMap: removing container" podUID="9678f4ef-361b-46ef-9d58-af00d81ee98d" containerName="seaweedfs-tls-custom" Oct 30 22:18:02.053652 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.053562 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9678f4ef-361b-46ef-9d58-af00d81ee98d" containerName="seaweedfs-tls-custom" Oct 30 22:18:02.053652 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.053638 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="9678f4ef-361b-46ef-9d58-af00d81ee98d" containerName="seaweedfs-tls-custom" Oct 30 22:18:02.056472 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.056453 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-685c9f986c-fdcpx" Oct 30 22:18:02.066912 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.066894 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9678f4ef-361b-46ef-9d58-af00d81ee98d-data\" (UniqueName: \"kubernetes.io/empty-dir/9678f4ef-361b-46ef-9d58-af00d81ee98d-data\") pod \"9678f4ef-361b-46ef-9d58-af00d81ee98d\" (UID: \"9678f4ef-361b-46ef-9d58-af00d81ee98d\") " Oct 30 22:18:02.066991 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.066963 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9678f4ef-361b-46ef-9d58-af00d81ee98d-kube-api-access-g5mfz\" (UniqueName: \"kubernetes.io/projected/9678f4ef-361b-46ef-9d58-af00d81ee98d-kube-api-access-g5mfz\") pod \"9678f4ef-361b-46ef-9d58-af00d81ee98d\" (UID: \"9678f4ef-361b-46ef-9d58-af00d81ee98d\") " Oct 30 22:18:02.068093 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.068066 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9678f4ef-361b-46ef-9d58-af00d81ee98d-data" pod "9678f4ef-361b-46ef-9d58-af00d81ee98d" (UID: "9678f4ef-361b-46ef-9d58-af00d81ee98d"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:18:02.069210 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.069183 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9678f4ef-361b-46ef-9d58-af00d81ee98d-kube-api-access-g5mfz" pod "9678f4ef-361b-46ef-9d58-af00d81ee98d" (UID: "9678f4ef-361b-46ef-9d58-af00d81ee98d"). InnerVolumeSpecName "kube-api-access-g5mfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:18:02.110496 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.110476 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom\"" Oct 30 22:18:02.116525 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.116498 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-685c9f986c-fdcpx"] Oct 30 22:18:02.167666 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.167641 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twqm6\" (UniqueName: \"kubernetes.io/projected/c6079239-5ba8-4f89-917e-689d863ea41b-kube-api-access-twqm6\") pod \"seaweedfs-tls-custom-685c9f986c-fdcpx\" (UID: \"c6079239-5ba8-4f89-917e-689d863ea41b\") " pod="kserve/seaweedfs-tls-custom-685c9f986c-fdcpx" Oct 30 22:18:02.167754 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.167672 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/c6079239-5ba8-4f89-917e-689d863ea41b-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-685c9f986c-fdcpx\" (UID: \"c6079239-5ba8-4f89-917e-689d863ea41b\") " pod="kserve/seaweedfs-tls-custom-685c9f986c-fdcpx" Oct 30 22:18:02.167754 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.167704 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c6079239-5ba8-4f89-917e-689d863ea41b-data\") pod \"seaweedfs-tls-custom-685c9f986c-fdcpx\" (UID: \"c6079239-5ba8-4f89-917e-689d863ea41b\") " pod="kserve/seaweedfs-tls-custom-685c9f986c-fdcpx" Oct 30 22:18:02.167845 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.167825 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5mfz\" (UniqueName: \"kubernetes.io/projected/9678f4ef-361b-46ef-9d58-af00d81ee98d-kube-api-access-g5mfz\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:18:02.167877 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.167852 4497 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9678f4ef-361b-46ef-9d58-af00d81ee98d-data\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:18:02.268917 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.268889 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c6079239-5ba8-4f89-917e-689d863ea41b-data\") pod \"seaweedfs-tls-custom-685c9f986c-fdcpx\" (UID: \"c6079239-5ba8-4f89-917e-689d863ea41b\") " pod="kserve/seaweedfs-tls-custom-685c9f986c-fdcpx" Oct 30 22:18:02.269029 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.268962 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twqm6\" (UniqueName: \"kubernetes.io/projected/c6079239-5ba8-4f89-917e-689d863ea41b-kube-api-access-twqm6\") pod \"seaweedfs-tls-custom-685c9f986c-fdcpx\" (UID: \"c6079239-5ba8-4f89-917e-689d863ea41b\") " pod="kserve/seaweedfs-tls-custom-685c9f986c-fdcpx" Oct 30 22:18:02.269029 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.268995 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/c6079239-5ba8-4f89-917e-689d863ea41b-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-685c9f986c-fdcpx\" (UID: \"c6079239-5ba8-4f89-917e-689d863ea41b\") " pod="kserve/seaweedfs-tls-custom-685c9f986c-fdcpx" Oct 30 22:18:02.269328 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.269306 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c6079239-5ba8-4f89-917e-689d863ea41b-data\") pod \"seaweedfs-tls-custom-685c9f986c-fdcpx\" (UID: \"c6079239-5ba8-4f89-917e-689d863ea41b\") " pod="kserve/seaweedfs-tls-custom-685c9f986c-fdcpx" Oct 30 22:18:02.271774 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.271745 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/c6079239-5ba8-4f89-917e-689d863ea41b-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-685c9f986c-fdcpx\" (UID: \"c6079239-5ba8-4f89-917e-689d863ea41b\") " pod="kserve/seaweedfs-tls-custom-685c9f986c-fdcpx" Oct 30 22:18:02.331362 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.331312 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twqm6\" (UniqueName: \"kubernetes.io/projected/c6079239-5ba8-4f89-917e-689d863ea41b-kube-api-access-twqm6\") pod \"seaweedfs-tls-custom-685c9f986c-fdcpx\" (UID: \"c6079239-5ba8-4f89-917e-689d863ea41b\") " pod="kserve/seaweedfs-tls-custom-685c9f986c-fdcpx" Oct 30 22:18:02.367158 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.367136 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-685c9f986c-fdcpx" Oct 30 22:18:02.660627 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.660590 4497 generic.go:356] "Generic (PLEG): container finished" podID="9678f4ef-361b-46ef-9d58-af00d81ee98d" containerID="c394281df7e09cdea35eea92d6e6dcbbc16f26f29354af3f0ec2e37e2a5c447e" exitCode=0 Oct 30 22:18:02.660774 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.660641 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-64cc6669cb-74z68" Oct 30 22:18:02.660774 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.660652 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-64cc6669cb-74z68" event={"ID":"9678f4ef-361b-46ef-9d58-af00d81ee98d","Type":"ContainerDied","Data":"c394281df7e09cdea35eea92d6e6dcbbc16f26f29354af3f0ec2e37e2a5c447e"} Oct 30 22:18:02.660774 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.660701 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-64cc6669cb-74z68" event={"ID":"9678f4ef-361b-46ef-9d58-af00d81ee98d","Type":"ContainerDied","Data":"340c3ad5dc8e88e259f90d080f4bee84def6f7c57db6bb80316e5c8883fa6b83"} Oct 30 22:18:02.660774 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.660729 4497 scope.go:122] "RemoveContainer" containerID="c394281df7e09cdea35eea92d6e6dcbbc16f26f29354af3f0ec2e37e2a5c447e" Oct 30 22:18:02.677348 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.677321 4497 scope.go:122] "RemoveContainer" containerID="c394281df7e09cdea35eea92d6e6dcbbc16f26f29354af3f0ec2e37e2a5c447e" Oct 30 22:18:02.677621 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:18:02.677604 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c394281df7e09cdea35eea92d6e6dcbbc16f26f29354af3f0ec2e37e2a5c447e\": container with ID starting with c394281df7e09cdea35eea92d6e6dcbbc16f26f29354af3f0ec2e37e2a5c447e not found: ID does not exist" containerID="c394281df7e09cdea35eea92d6e6dcbbc16f26f29354af3f0ec2e37e2a5c447e" Oct 30 22:18:02.677670 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.677630 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c394281df7e09cdea35eea92d6e6dcbbc16f26f29354af3f0ec2e37e2a5c447e"} err="failed to get container status \"c394281df7e09cdea35eea92d6e6dcbbc16f26f29354af3f0ec2e37e2a5c447e\": rpc error: code = NotFound desc = could not find container \"c394281df7e09cdea35eea92d6e6dcbbc16f26f29354af3f0ec2e37e2a5c447e\": container with ID starting with c394281df7e09cdea35eea92d6e6dcbbc16f26f29354af3f0ec2e37e2a5c447e not found: ID does not exist" Oct 30 22:18:02.738563 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.738540 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-685c9f986c-fdcpx"] Oct 30 22:18:02.741383 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:18:02.741360 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6079239_5ba8_4f89_917e_689d863ea41b.slice/crio-964c429616657a32df897f8e6686e704318803b01bbc4d3f40cc84292b37c1a2 WatchSource:0}: Error finding container 964c429616657a32df897f8e6686e704318803b01bbc4d3f40cc84292b37c1a2: Status 404 returned error can't find the container with id 964c429616657a32df897f8e6686e704318803b01bbc4d3f40cc84292b37c1a2 Oct 30 22:18:02.829178 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.829154 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-64cc6669cb-74z68"] Oct 30 22:18:02.844087 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:02.844062 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kserve/seaweedfs-tls-custom-64cc6669cb-74z68"] Oct 30 22:18:03.539494 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:03.539469 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9678f4ef-361b-46ef-9d58-af00d81ee98d" path="/var/lib/kubelet/pods/9678f4ef-361b-46ef-9d58-af00d81ee98d/volumes" Oct 30 22:18:03.665462 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:03.665430 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-685c9f986c-fdcpx" event={"ID":"c6079239-5ba8-4f89-917e-689d863ea41b","Type":"ContainerStarted","Data":"15a4b5e20e2eaa9ec5f8277a640e517fa8e98aa22b2786f3ff8f713b6e3c62aa"} Oct 30 22:18:03.665614 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:03.665480 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-685c9f986c-fdcpx" event={"ID":"c6079239-5ba8-4f89-917e-689d863ea41b","Type":"ContainerStarted","Data":"964c429616657a32df897f8e6686e704318803b01bbc4d3f40cc84292b37c1a2"} Oct 30 22:18:03.782733 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:03.782643 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-685c9f986c-fdcpx" podStartSLOduration=1.019770993 podStartE2EDuration="1.782628637s" totalImagesPullingTime="762.857644ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:18:03.782148704 +0000 UTC m=+578.409214255" watchObservedRunningTime="2026-10-30 22:18:03.782628637 +0000 UTC m=+578.409694187" Oct 30 22:18:15.362799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:15.362712 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:18.260597 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:18.260555 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:18.579288 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:18.579201 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:29.653104 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:18:29.653072 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:18:35.842231 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:35.842191 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:36.131988 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:36.131961 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:49.518909 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:49.518872 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:49.869586 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:49.869498 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:52.844959 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:52.844925 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:53.148258 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:53.148209 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:56.432704 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:56.432668 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:56.713582 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:56.713501 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:57.831452 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:57.831412 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:58.083363 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:18:58.083269 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:59.654655 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:18:59.654620 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:19:15.798161 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:19:15.798125 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:19:29.653895 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:19:29.653858 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:19:59.654366 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:19:59.654284 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:20:16.322861 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:20:16.322819 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:20:29.653718 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:20:29.653681 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:20:48.838368 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:20:48.838327 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:20:55.116032 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:20:55.115987 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:20:55.399641 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:20:55.399614 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:20:59.653627 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:20:59.653591 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:21:12.670695 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:21:12.670610 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:21:14.895615 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:21:14.895569 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:21:16.493893 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:21:16.493850 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:21:29.656911 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:21:29.656869 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:21:45.542296 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:21:45.542262 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:21:45.822970 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:21:45.822901 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:21:59.652509 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:21:59.652471 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:22:16.857141 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:22:16.857109 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:22:29.655166 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:22:29.655133 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:22:34.571418 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:22:34.571383 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:22:51.039968 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:22:51.039928 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:22:51.346204 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:22:51.346112 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:22:59.654796 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:22:59.654754 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:23:11.901818 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:11.901779 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:13.539325 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:13.539289 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:17.179110 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:17.179076 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:17.459034 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:17.458946 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:21.699417 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:21.699389 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:21.974833 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:21.974749 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:29.654424 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:23:29.654391 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:23:31.866577 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:31.866534 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:35.943057 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:35.943010 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:36.210651 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:36.210556 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:53.342892 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:53.342853 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:53.430835 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:53.430806 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx"] Oct 30 22:23:53.434501 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:53.434478 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx" Oct 30 22:23:53.488357 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:53.488332 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"kube-root-ca.crt\"" Oct 30 22:23:53.488357 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:53.488332 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"openshift-service-ca.crt\"" Oct 30 22:23:53.537728 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:53.537701 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"default-dockercfg-s9cqw\"" Oct 30 22:23:53.539519 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:53.539503 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx"] Oct 30 22:23:53.555633 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:53.555611 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b99z\" (UniqueName: \"kubernetes.io/projected/7e5dc6f4-d839-46e2-9a79-3f9349054be8-kube-api-access-2b99z\") pod \"proxy-routing-9b710916-sink-79f69849b4-bhgwx\" (UID: \"7e5dc6f4-d839-46e2-9a79-3f9349054be8\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx" Oct 30 22:23:53.610429 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:53.610363 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:53.656921 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:53.656899 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b99z\" (UniqueName: \"kubernetes.io/projected/7e5dc6f4-d839-46e2-9a79-3f9349054be8-kube-api-access-2b99z\") pod \"proxy-routing-9b710916-sink-79f69849b4-bhgwx\" (UID: \"7e5dc6f4-d839-46e2-9a79-3f9349054be8\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx" Oct 30 22:23:53.720640 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:53.720611 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b99z\" (UniqueName: \"kubernetes.io/projected/7e5dc6f4-d839-46e2-9a79-3f9349054be8-kube-api-access-2b99z\") pod \"proxy-routing-9b710916-sink-79f69849b4-bhgwx\" (UID: \"7e5dc6f4-d839-46e2-9a79-3f9349054be8\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx" Oct 30 22:23:53.748380 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:53.748361 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx" Oct 30 22:23:54.119356 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:54.119330 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx"] Oct 30 22:23:54.121887 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:23:54.121859 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e5dc6f4_d839_46e2_9a79_3f9349054be8.slice/crio-fdf1e63b4bbb1dc9fa6e979cfcd6e1f471142cb3e2baa8bd4dd9433956c7dd9d WatchSource:0}: Error finding container fdf1e63b4bbb1dc9fa6e979cfcd6e1f471142cb3e2baa8bd4dd9433956c7dd9d: Status 404 returned error can't find the container with id fdf1e63b4bbb1dc9fa6e979cfcd6e1f471142cb3e2baa8bd4dd9433956c7dd9d Oct 30 22:23:54.125529 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:54.125505 4497 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:23:55.001988 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:55.001949 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx" event={"ID":"7e5dc6f4-d839-46e2-9a79-3f9349054be8","Type":"ContainerStarted","Data":"fdf1e63b4bbb1dc9fa6e979cfcd6e1f471142cb3e2baa8bd4dd9433956c7dd9d"} Oct 30 22:23:57.011703 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:57.011624 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx" event={"ID":"7e5dc6f4-d839-46e2-9a79-3f9349054be8","Type":"ContainerStarted","Data":"6b67d625f3b2e98fcdf387258a93122b428cd9b3506f1dca11c1c2358a6eb26d"} Oct 30 22:23:57.012090 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:57.011849 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx" Oct 30 22:23:57.013862 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:57.013843 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx" Oct 30 22:23:57.130550 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:57.130505 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx" podStartSLOduration=1.577119301 podStartE2EDuration="4.130490867s" totalImagesPullingTime="2.553371566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:23:57.130417158 +0000 UTC m=+931.757482709" watchObservedRunningTime="2026-10-30 22:23:57.130490867 +0000 UTC m=+931.757556421" Oct 30 22:23:59.311419 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:59.311388 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:59.634215 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:23:59.634182 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:59.654413 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:23:59.654382 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:24:02.634505 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:02.634469 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:24:02.992668 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:02.992562 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:24:03.412794 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:03.412765 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd"] Oct 30 22:24:03.416213 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:03.416196 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:03.519973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:03.519912 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2c6ec608-8a33-47f6-baf1-46325de68524-proxy-tls\") pod \"proxy-routing-9b710916-predictor-b64cf69cb-72jwd\" (UID: \"2c6ec608-8a33-47f6-baf1-46325de68524\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:03.519973 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:03.519964 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2c6ec608-8a33-47f6-baf1-46325de68524-kube-rbac-proxy-sar-config\") pod \"proxy-routing-9b710916-predictor-b64cf69cb-72jwd\" (UID: \"2c6ec608-8a33-47f6-baf1-46325de68524\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:03.520165 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:03.519988 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf7mn\" (UniqueName: \"kubernetes.io/projected/2c6ec608-8a33-47f6-baf1-46325de68524-kube-api-access-qf7mn\") pod \"proxy-routing-9b710916-predictor-b64cf69cb-72jwd\" (UID: \"2c6ec608-8a33-47f6-baf1-46325de68524\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:03.520423 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:03.520400 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"proxy-routing-9b710916-predictor-serving-cert\"" Oct 30 22:24:03.520423 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:03.520416 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"proxy-routing-9b710916-dockercfg-dzxnb\"" Oct 30 22:24:03.520543 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:03.520487 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"proxy-routing-9b710916-kube-rbac-proxy-sar-config\"" Oct 30 22:24:03.521695 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:03.521672 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd"] Oct 30 22:24:03.620937 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:03.620901 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2c6ec608-8a33-47f6-baf1-46325de68524-proxy-tls\") pod \"proxy-routing-9b710916-predictor-b64cf69cb-72jwd\" (UID: \"2c6ec608-8a33-47f6-baf1-46325de68524\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:03.621132 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:03.620974 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2c6ec608-8a33-47f6-baf1-46325de68524-kube-rbac-proxy-sar-config\") pod \"proxy-routing-9b710916-predictor-b64cf69cb-72jwd\" (UID: \"2c6ec608-8a33-47f6-baf1-46325de68524\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:03.621132 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:03.621014 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf7mn\" (UniqueName: \"kubernetes.io/projected/2c6ec608-8a33-47f6-baf1-46325de68524-kube-api-access-qf7mn\") pod \"proxy-routing-9b710916-predictor-b64cf69cb-72jwd\" (UID: \"2c6ec608-8a33-47f6-baf1-46325de68524\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:03.621664 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:03.621641 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2c6ec608-8a33-47f6-baf1-46325de68524-kube-rbac-proxy-sar-config\") pod \"proxy-routing-9b710916-predictor-b64cf69cb-72jwd\" (UID: \"2c6ec608-8a33-47f6-baf1-46325de68524\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:03.623505 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:03.623487 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2c6ec608-8a33-47f6-baf1-46325de68524-proxy-tls\") pod \"proxy-routing-9b710916-predictor-b64cf69cb-72jwd\" (UID: \"2c6ec608-8a33-47f6-baf1-46325de68524\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:03.684377 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:03.684309 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf7mn\" (UniqueName: \"kubernetes.io/projected/2c6ec608-8a33-47f6-baf1-46325de68524-kube-api-access-qf7mn\") pod \"proxy-routing-9b710916-predictor-b64cf69cb-72jwd\" (UID: \"2c6ec608-8a33-47f6-baf1-46325de68524\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:03.717996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:03.717971 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:24:08.256195 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:08.256164 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-dec0a744-c952-4511-9a80-791b293e3ace\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a717ec2c915c82b3\") pod \"proxy-routing-9b710916-predictor-b64cf69cb-72jwd\" (UID: \"2c6ec608-8a33-47f6-baf1-46325de68524\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:08.362157 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:08.362094 4497 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-dec0a744-c952-4511-9a80-791b293e3ace\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a717ec2c915c82b3\") pod \"proxy-routing-9b710916-predictor-b64cf69cb-72jwd\" (UID: \"2c6ec608-8a33-47f6-baf1-46325de68524\") device path: \"\"" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:08.457556 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:08.457528 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-dec0a744-c952-4511-9a80-791b293e3ace\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a717ec2c915c82b3\") pod \"proxy-routing-9b710916-predictor-b64cf69cb-72jwd\" (UID: \"2c6ec608-8a33-47f6-baf1-46325de68524\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:08.457686 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:08.457674 4497 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-dec0a744-c952-4511-9a80-791b293e3ace\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a717ec2c915c82b3\") pod \"proxy-routing-9b710916-predictor-b64cf69cb-72jwd\" (UID: \"2c6ec608-8a33-47f6-baf1-46325de68524\") DevicePath \"\"" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:08.510741 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:08.510713 4497 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-dec0a744-c952-4511-9a80-791b293e3ace\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a717ec2c915c82b3\") pod \"proxy-routing-9b710916-predictor-b64cf69cb-72jwd\" (UID: \"2c6ec608-8a33-47f6-baf1-46325de68524\") DevicePath \"csi-4530b02d006f19c4a2bae08e5a551c095492084225305aa8bb7a4eee88b38444\"" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:08.725850 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:08.725811 4497 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-dec0a744-c952-4511-9a80-791b293e3ace\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a717ec2c915c82b3\") pod \"proxy-routing-9b710916-predictor-b64cf69cb-72jwd\" (UID: \"2c6ec608-8a33-47f6-baf1-46325de68524\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/3df86c38e6af2266ab2653be5b7ae23669c0dc68332a3f5a2c3c9b4ee742f59e/globalmount\"" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:08.790187 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:08.790139 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-dec0a744-c952-4511-9a80-791b293e3ace\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a717ec2c915c82b3\") pod \"proxy-routing-9b710916-predictor-b64cf69cb-72jwd\" (UID: \"2c6ec608-8a33-47f6-baf1-46325de68524\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:09.129388 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:09.129361 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:09.553195 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:09.553172 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd"] Oct 30 22:24:09.555779 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:24:09.555750 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c6ec608_8a33_47f6_baf1_46325de68524.slice/crio-96c0e59052c12cc741d7b5531c4f4e9aefa32fdfb29612438e544bde2d027180 WatchSource:0}: Error finding container 96c0e59052c12cc741d7b5531c4f4e9aefa32fdfb29612438e544bde2d027180: Status 404 returned error can't find the container with id 96c0e59052c12cc741d7b5531c4f4e9aefa32fdfb29612438e544bde2d027180 Oct 30 22:24:10.063683 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:10.063654 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" event={"ID":"2c6ec608-8a33-47f6-baf1-46325de68524","Type":"ContainerStarted","Data":"f388f7dc9aef64642f27966a9d56246e08e53d3e95c056049e84ee68e8fb77ea"} Oct 30 22:24:10.063835 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:10.063708 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" event={"ID":"2c6ec608-8a33-47f6-baf1-46325de68524","Type":"ContainerStarted","Data":"96c0e59052c12cc741d7b5531c4f4e9aefa32fdfb29612438e544bde2d027180"} Oct 30 22:24:13.076649 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:13.076614 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" event={"ID":"2c6ec608-8a33-47f6-baf1-46325de68524","Type":"ContainerStarted","Data":"62cd968c8226136a15d8f8b6f47148bcb555f94d50417d22377b203e2fe300da"} Oct 30 22:24:13.077020 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:13.076677 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:13.077020 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:13.076724 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:13.079157 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:13.079139 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:13.242742 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:13.242662 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" podStartSLOduration=10.957541238 podStartE2EDuration="14.242648775s" totalImagesPullingTime="3.285107537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:24:13.196787906 +0000 UTC m=+947.823853460" watchObservedRunningTime="2026-10-30 22:24:13.242648775 +0000 UTC m=+947.869714325" Oct 30 22:24:17.593669 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:17.593636 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:24:19.617071 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:19.617034 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:24:20.088794 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:20.088765 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:29.448931 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:29.448900 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x"] Oct 30 22:24:29.452642 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:29.452626 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:29.513573 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:29.513552 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwnhf\" (UniqueName: \"kubernetes.io/projected/75a6a15d-d957-4be3-8073-6b1f2913b0d8-kube-api-access-wwnhf\") pod \"proxy-routing-9b710916-predictor-86c4c4d744-jm68x\" (UID: \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:29.513690 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:29.513600 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/75a6a15d-d957-4be3-8073-6b1f2913b0d8-proxy-tls\") pod \"proxy-routing-9b710916-predictor-86c4c4d744-jm68x\" (UID: \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:29.513690 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:29.513625 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/75a6a15d-d957-4be3-8073-6b1f2913b0d8-kube-rbac-proxy-sar-config\") pod \"proxy-routing-9b710916-predictor-86c4c4d744-jm68x\" (UID: \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:29.554123 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:29.554095 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x"] Oct 30 22:24:29.614641 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:29.614615 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/75a6a15d-d957-4be3-8073-6b1f2913b0d8-proxy-tls\") pod \"proxy-routing-9b710916-predictor-86c4c4d744-jm68x\" (UID: \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:29.614745 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:29.614652 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/75a6a15d-d957-4be3-8073-6b1f2913b0d8-kube-rbac-proxy-sar-config\") pod \"proxy-routing-9b710916-predictor-86c4c4d744-jm68x\" (UID: \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:29.614745 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:29.614674 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-dec0a744-c952-4511-9a80-791b293e3ace\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a717ec2c915c82b3\") pod \"proxy-routing-9b710916-predictor-86c4c4d744-jm68x\" (UID: \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:29.614745 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:29.614695 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwnhf\" (UniqueName: \"kubernetes.io/projected/75a6a15d-d957-4be3-8073-6b1f2913b0d8-kube-api-access-wwnhf\") pod \"proxy-routing-9b710916-predictor-86c4c4d744-jm68x\" (UID: \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:29.614903 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:29.614772 4497 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-dec0a744-c952-4511-9a80-791b293e3ace\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a717ec2c915c82b3\") pod \"proxy-routing-9b710916-predictor-86c4c4d744-jm68x\" (UID: \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\") DevicePath \"csi-4530b02d006f19c4a2bae08e5a551c095492084225305aa8bb7a4eee88b38444\"" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:29.615387 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:29.615368 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/75a6a15d-d957-4be3-8073-6b1f2913b0d8-kube-rbac-proxy-sar-config\") pod \"proxy-routing-9b710916-predictor-86c4c4d744-jm68x\" (UID: \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:29.617037 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:29.617018 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/75a6a15d-d957-4be3-8073-6b1f2913b0d8-proxy-tls\") pod \"proxy-routing-9b710916-predictor-86c4c4d744-jm68x\" (UID: \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:29.653911 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:24:29.653886 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:24:29.667098 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:29.667075 4497 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-dec0a744-c952-4511-9a80-791b293e3ace\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a717ec2c915c82b3\") pod \"proxy-routing-9b710916-predictor-86c4c4d744-jm68x\" (UID: \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\") DevicePath \"csi-4530b02d006f19c4a2bae08e5a551c095492084225305aa8bb7a4eee88b38444\"" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:29.676780 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:29.676756 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwnhf\" (UniqueName: \"kubernetes.io/projected/75a6a15d-d957-4be3-8073-6b1f2913b0d8-kube-api-access-wwnhf\") pod \"proxy-routing-9b710916-predictor-86c4c4d744-jm68x\" (UID: \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:29.727607 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:29.727549 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-dec0a744-c952-4511-9a80-791b293e3ace\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a717ec2c915c82b3\") pod \"proxy-routing-9b710916-predictor-86c4c4d744-jm68x\" (UID: \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\") " pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:30.068222 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:30.068150 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:30.500775 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:30.500747 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x"] Oct 30 22:24:30.502719 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:24:30.502689 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a6a15d_d957_4be3_8073_6b1f2913b0d8.slice/crio-6a0c15585252c4291421a22a304182ba042aff73f8840da8be5d8d9520f2ee0e WatchSource:0}: Error finding container 6a0c15585252c4291421a22a304182ba042aff73f8840da8be5d8d9520f2ee0e: Status 404 returned error can't find the container with id 6a0c15585252c4291421a22a304182ba042aff73f8840da8be5d8d9520f2ee0e Oct 30 22:24:31.148360 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:31.148320 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" event={"ID":"75a6a15d-d957-4be3-8073-6b1f2913b0d8","Type":"ContainerStarted","Data":"d77f1a942b511047051c484c2182b36e10b6756c6839f5905144921328ef767c"} Oct 30 22:24:31.148549 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:31.148394 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" event={"ID":"75a6a15d-d957-4be3-8073-6b1f2913b0d8","Type":"ContainerStarted","Data":"a090fc7172389fbd587eeb54379b23809f4a5db1f43e988caac1d227dbd37315"} Oct 30 22:24:31.148549 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:31.148418 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" event={"ID":"75a6a15d-d957-4be3-8073-6b1f2913b0d8","Type":"ContainerStarted","Data":"6a0c15585252c4291421a22a304182ba042aff73f8840da8be5d8d9520f2ee0e"} Oct 30 22:24:37.175025 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:37.174971 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" event={"ID":"75a6a15d-d957-4be3-8073-6b1f2913b0d8","Type":"ContainerStarted","Data":"36181f0a072b51be5c5c9fe3d27cddaa7ce3c66c4274b90d01a63ff7a224ba6a"} Oct 30 22:24:37.175544 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:37.175074 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:37.175544 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:37.175112 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:37.177639 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:37.177608 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:37.180379 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:37.180363 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:37.362263 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:37.362189 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" podStartSLOduration=2.573764975 podStartE2EDuration="8.362179268s" totalImagesPullingTime="5.788414293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:24:37.361390773 +0000 UTC m=+971.988456323" watchObservedRunningTime="2026-10-30 22:24:37.362179268 +0000 UTC m=+971.989244818" Oct 30 22:24:38.179649 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:38.179611 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:38.181220 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:38.181203 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:24:38.403695 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:38.403670 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd"] Oct 30 22:24:38.404070 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:38.404041 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" podUID="2c6ec608-8a33-47f6-baf1-46325de68524" containerName="kserve-container" containerID="cri-o://f388f7dc9aef64642f27966a9d56246e08e53d3e95c056049e84ee68e8fb77ea" gracePeriod=30 Oct 30 22:24:38.404383 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:38.404151 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" podUID="2c6ec608-8a33-47f6-baf1-46325de68524" containerName="kube-rbac-proxy" containerID="cri-o://62cd968c8226136a15d8f8b6f47148bcb555f94d50417d22377b203e2fe300da" gracePeriod=30 Oct 30 22:24:39.184582 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:39.184547 4497 generic.go:356] "Generic (PLEG): container finished" podID="2c6ec608-8a33-47f6-baf1-46325de68524" containerID="62cd968c8226136a15d8f8b6f47148bcb555f94d50417d22377b203e2fe300da" exitCode=0 Oct 30 22:24:39.184959 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:39.184621 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" event={"ID":"2c6ec608-8a33-47f6-baf1-46325de68524","Type":"ContainerDied","Data":"62cd968c8226136a15d8f8b6f47148bcb555f94d50417d22377b203e2fe300da"} Oct 30 22:24:40.084641 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:40.084592 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" podUID="2c6ec608-8a33-47f6-baf1-46325de68524" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.27:8643/healthz\": dial tcp 10.133.0.27:8643: connect: connection refused" Oct 30 22:24:45.084423 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:45.084383 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" podUID="2c6ec608-8a33-47f6-baf1-46325de68524" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.27:8643/healthz\": dial tcp 10.133.0.27:8643: connect: connection refused" Oct 30 22:24:50.084284 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:50.084221 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" podUID="2c6ec608-8a33-47f6-baf1-46325de68524" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.27:8643/healthz\": dial tcp 10.133.0.27:8643: connect: connection refused" Oct 30 22:24:50.084825 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:50.084352 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:24:55.084680 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:24:55.084629 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" podUID="2c6ec608-8a33-47f6-baf1-46325de68524" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.27:8643/healthz\": dial tcp 10.133.0.27:8643: connect: connection refused" Oct 30 22:24:59.653932 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:24:59.653891 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:25:00.084845 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:00.084759 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" podUID="2c6ec608-8a33-47f6-baf1-46325de68524" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.27:8643/healthz\": dial tcp 10.133.0.27:8643: connect: connection refused" Oct 30 22:25:05.084864 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:05.084824 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" podUID="2c6ec608-8a33-47f6-baf1-46325de68524" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.27:8643/healthz\": dial tcp 10.133.0.27:8643: connect: connection refused" Oct 30 22:25:08.584311 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:08.584289 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:25:08.717792 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:08.717726 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2c6ec608-8a33-47f6-baf1-46325de68524-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2c6ec608-8a33-47f6-baf1-46325de68524-kube-rbac-proxy-sar-config\") pod \"2c6ec608-8a33-47f6-baf1-46325de68524\" (UID: \"2c6ec608-8a33-47f6-baf1-46325de68524\") " Oct 30 22:25:08.717792 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:08.717770 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2c6ec608-8a33-47f6-baf1-46325de68524-proxy-tls\" (UniqueName: \"kubernetes.io/secret/2c6ec608-8a33-47f6-baf1-46325de68524-proxy-tls\") pod \"2c6ec608-8a33-47f6-baf1-46325de68524\" (UID: \"2c6ec608-8a33-47f6-baf1-46325de68524\") " Oct 30 22:25:08.717946 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:08.717848 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a717ec2c915c82b3\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a717ec2c915c82b3\") pod \"2c6ec608-8a33-47f6-baf1-46325de68524\" (UID: \"2c6ec608-8a33-47f6-baf1-46325de68524\") " Oct 30 22:25:08.717946 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:08.717869 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2c6ec608-8a33-47f6-baf1-46325de68524-kube-api-access-qf7mn\" (UniqueName: \"kubernetes.io/projected/2c6ec608-8a33-47f6-baf1-46325de68524-kube-api-access-qf7mn\") pod \"2c6ec608-8a33-47f6-baf1-46325de68524\" (UID: \"2c6ec608-8a33-47f6-baf1-46325de68524\") " Oct 30 22:25:08.718123 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:08.718098 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c6ec608-8a33-47f6-baf1-46325de68524-kube-rbac-proxy-sar-config" pod "2c6ec608-8a33-47f6-baf1-46325de68524" (UID: "2c6ec608-8a33-47f6-baf1-46325de68524"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:25:08.720112 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:08.720084 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c6ec608-8a33-47f6-baf1-46325de68524-proxy-tls" pod "2c6ec608-8a33-47f6-baf1-46325de68524" (UID: "2c6ec608-8a33-47f6-baf1-46325de68524"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:25:08.720283 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:08.720261 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c6ec608-8a33-47f6-baf1-46325de68524-kube-api-access-qf7mn" pod "2c6ec608-8a33-47f6-baf1-46325de68524" (UID: "2c6ec608-8a33-47f6-baf1-46325de68524"). InnerVolumeSpecName "kube-api-access-qf7mn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:25:08.721463 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:08.721446 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a717ec2c915c82b3" pod "2c6ec608-8a33-47f6-baf1-46325de68524" (UID: "2c6ec608-8a33-47f6-baf1-46325de68524"). InnerVolumeSpecName "pvc-dec0a744-c952-4511-9a80-791b293e3ace". PluginName "kubernetes.io/csi", VolumeGIDValue "" Oct 30 22:25:08.818776 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:08.818749 4497 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2c6ec608-8a33-47f6-baf1-46325de68524-proxy-tls\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:25:08.818776 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:08.818774 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf7mn\" (UniqueName: \"kubernetes.io/projected/2c6ec608-8a33-47f6-baf1-46325de68524-kube-api-access-qf7mn\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:25:08.818913 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:08.818785 4497 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2c6ec608-8a33-47f6-baf1-46325de68524-kube-rbac-proxy-sar-config\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:25:09.314316 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:09.314279 4497 generic.go:356] "Generic (PLEG): container finished" podID="2c6ec608-8a33-47f6-baf1-46325de68524" containerID="f388f7dc9aef64642f27966a9d56246e08e53d3e95c056049e84ee68e8fb77ea" exitCode=137 Oct 30 22:25:09.314493 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:09.314343 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" Oct 30 22:25:09.314493 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:09.314366 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" event={"ID":"2c6ec608-8a33-47f6-baf1-46325de68524","Type":"ContainerDied","Data":"f388f7dc9aef64642f27966a9d56246e08e53d3e95c056049e84ee68e8fb77ea"} Oct 30 22:25:09.314493 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:09.314435 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd" event={"ID":"2c6ec608-8a33-47f6-baf1-46325de68524","Type":"ContainerDied","Data":"96c0e59052c12cc741d7b5531c4f4e9aefa32fdfb29612438e544bde2d027180"} Oct 30 22:25:09.314493 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:09.314472 4497 scope.go:122] "RemoveContainer" containerID="62cd968c8226136a15d8f8b6f47148bcb555f94d50417d22377b203e2fe300da" Oct 30 22:25:09.324029 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:09.324011 4497 scope.go:122] "RemoveContainer" containerID="f388f7dc9aef64642f27966a9d56246e08e53d3e95c056049e84ee68e8fb77ea" Oct 30 22:25:09.331679 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:09.331655 4497 scope.go:122] "RemoveContainer" containerID="62cd968c8226136a15d8f8b6f47148bcb555f94d50417d22377b203e2fe300da" Oct 30 22:25:09.331980 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:25:09.331956 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62cd968c8226136a15d8f8b6f47148bcb555f94d50417d22377b203e2fe300da\": container with ID starting with 62cd968c8226136a15d8f8b6f47148bcb555f94d50417d22377b203e2fe300da not found: ID does not exist" containerID="62cd968c8226136a15d8f8b6f47148bcb555f94d50417d22377b203e2fe300da" Oct 30 22:25:09.332055 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:09.331987 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62cd968c8226136a15d8f8b6f47148bcb555f94d50417d22377b203e2fe300da"} err="failed to get container status \"62cd968c8226136a15d8f8b6f47148bcb555f94d50417d22377b203e2fe300da\": rpc error: code = NotFound desc = could not find container \"62cd968c8226136a15d8f8b6f47148bcb555f94d50417d22377b203e2fe300da\": container with ID starting with 62cd968c8226136a15d8f8b6f47148bcb555f94d50417d22377b203e2fe300da not found: ID does not exist" Oct 30 22:25:09.332055 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:09.332005 4497 scope.go:122] "RemoveContainer" containerID="f388f7dc9aef64642f27966a9d56246e08e53d3e95c056049e84ee68e8fb77ea" Oct 30 22:25:09.332306 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:25:09.332286 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f388f7dc9aef64642f27966a9d56246e08e53d3e95c056049e84ee68e8fb77ea\": container with ID starting with f388f7dc9aef64642f27966a9d56246e08e53d3e95c056049e84ee68e8fb77ea not found: ID does not exist" containerID="f388f7dc9aef64642f27966a9d56246e08e53d3e95c056049e84ee68e8fb77ea" Oct 30 22:25:09.332364 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:09.332315 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f388f7dc9aef64642f27966a9d56246e08e53d3e95c056049e84ee68e8fb77ea"} err="failed to get container status \"f388f7dc9aef64642f27966a9d56246e08e53d3e95c056049e84ee68e8fb77ea\": rpc error: code = NotFound desc = could not find container \"f388f7dc9aef64642f27966a9d56246e08e53d3e95c056049e84ee68e8fb77ea\": container with ID starting with f388f7dc9aef64642f27966a9d56246e08e53d3e95c056049e84ee68e8fb77ea not found: ID does not exist" Oct 30 22:25:09.530859 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:09.530834 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd"] Oct 30 22:25:09.580388 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:09.580335 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-b64cf69cb-72jwd"] Oct 30 22:25:10.510002 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:10.509969 4497 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-959ee2f135_proxy-routing-9b710916-sink-79f69849b4-bhgwx_7e5dc6f4-d839-46e2-9a79-3f9349054be8/kserve-container/0.log" Oct 30 22:25:10.711657 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:10.711622 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx"] Oct 30 22:25:10.711860 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:10.711838 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx" podUID="7e5dc6f4-d839-46e2-9a79-3f9349054be8" containerName="kserve-container" containerID="cri-o://6b67d625f3b2e98fcdf387258a93122b428cd9b3506f1dca11c1c2358a6eb26d" gracePeriod=30 Oct 30 22:25:10.876189 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:10.876152 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:11.150002 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:11.149927 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:11.540126 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:11.540053 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2c6ec608-8a33-47f6-baf1-46325de68524" path="/var/lib/kubelet/pods/2c6ec608-8a33-47f6-baf1-46325de68524/volumes" Oct 30 22:25:11.945593 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:11.945562 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x"] Oct 30 22:25:11.945821 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:11.945796 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="agent" containerID="cri-o://36181f0a072b51be5c5c9fe3d27cddaa7ce3c66c4274b90d01a63ff7a224ba6a" gracePeriod=30 Oct 30 22:25:11.945901 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:11.945825 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="kube-rbac-proxy" containerID="cri-o://d77f1a942b511047051c484c2182b36e10b6756c6839f5905144921328ef767c" gracePeriod=30 Oct 30 22:25:11.945901 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:11.945784 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="kserve-container" containerID="cri-o://a090fc7172389fbd587eeb54379b23809f4a5db1f43e988caac1d227dbd37315" gracePeriod=30 Oct 30 22:25:12.069148 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:12.069125 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:12.175865 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:12.175831 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.28:8643/healthz\": dial tcp 10.133.0.28:8643: connect: connection refused" Oct 30 22:25:12.334760 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:12.330557 4497 generic.go:356] "Generic (PLEG): container finished" podID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerID="d77f1a942b511047051c484c2182b36e10b6756c6839f5905144921328ef767c" exitCode=0 Oct 30 22:25:12.334760 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:12.330685 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" event={"ID":"75a6a15d-d957-4be3-8073-6b1f2913b0d8","Type":"ContainerDied","Data":"d77f1a942b511047051c484c2182b36e10b6756c6839f5905144921328ef767c"} Oct 30 22:25:17.023187 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:17.023153 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:17.176004 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:17.175970 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.28:8643/healthz\": dial tcp 10.133.0.28:8643: connect: connection refused" Oct 30 22:25:17.919933 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:17.919901 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:18.180812 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:18.180733 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:25:22.175702 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:22.175652 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.28:8643/healthz\": dial tcp 10.133.0.28:8643: connect: connection refused" Oct 30 22:25:22.176080 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:22.175782 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:25:25.595684 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:25.595649 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:25.875570 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:25.875539 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:27.176334 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:27.176292 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.28:8643/healthz\": dial tcp 10.133.0.28:8643: connect: connection refused" Oct 30 22:25:28.180607 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:28.180557 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:25:29.653414 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:25:29.653380 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:25:32.175853 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:32.175811 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.28:8643/healthz\": dial tcp 10.133.0.28:8643: connect: connection refused" Oct 30 22:25:37.175419 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:37.175332 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.28:8643/healthz\": dial tcp 10.133.0.28:8643: connect: connection refused" Oct 30 22:25:38.180663 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:38.180625 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:25:38.181051 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:38.180739 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:25:40.860149 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:40.860117 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:40.890481 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:40.890459 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx" Oct 30 22:25:40.942274 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:40.942253 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7e5dc6f4-d839-46e2-9a79-3f9349054be8-kube-api-access-2b99z\" (UniqueName: \"kubernetes.io/projected/7e5dc6f4-d839-46e2-9a79-3f9349054be8-kube-api-access-2b99z\") pod \"7e5dc6f4-d839-46e2-9a79-3f9349054be8\" (UID: \"7e5dc6f4-d839-46e2-9a79-3f9349054be8\") " Oct 30 22:25:40.944256 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:40.944210 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e5dc6f4-d839-46e2-9a79-3f9349054be8-kube-api-access-2b99z" pod "7e5dc6f4-d839-46e2-9a79-3f9349054be8" (UID: "7e5dc6f4-d839-46e2-9a79-3f9349054be8"). InnerVolumeSpecName "kube-api-access-2b99z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:25:41.043721 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:41.043667 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b99z\" (UniqueName: \"kubernetes.io/projected/7e5dc6f4-d839-46e2-9a79-3f9349054be8-kube-api-access-2b99z\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:25:41.443679 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:41.443647 4497 generic.go:356] "Generic (PLEG): container finished" podID="7e5dc6f4-d839-46e2-9a79-3f9349054be8" containerID="6b67d625f3b2e98fcdf387258a93122b428cd9b3506f1dca11c1c2358a6eb26d" exitCode=137 Oct 30 22:25:41.443865 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:41.443700 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx" Oct 30 22:25:41.443865 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:41.443735 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx" event={"ID":"7e5dc6f4-d839-46e2-9a79-3f9349054be8","Type":"ContainerDied","Data":"6b67d625f3b2e98fcdf387258a93122b428cd9b3506f1dca11c1c2358a6eb26d"} Oct 30 22:25:41.443865 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:41.443783 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx" event={"ID":"7e5dc6f4-d839-46e2-9a79-3f9349054be8","Type":"ContainerDied","Data":"fdf1e63b4bbb1dc9fa6e979cfcd6e1f471142cb3e2baa8bd4dd9433956c7dd9d"} Oct 30 22:25:41.443865 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:41.443805 4497 scope.go:122] "RemoveContainer" containerID="6b67d625f3b2e98fcdf387258a93122b428cd9b3506f1dca11c1c2358a6eb26d" Oct 30 22:25:41.451950 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:41.451934 4497 scope.go:122] "RemoveContainer" containerID="6b67d625f3b2e98fcdf387258a93122b428cd9b3506f1dca11c1c2358a6eb26d" Oct 30 22:25:41.452168 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:25:41.452150 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b67d625f3b2e98fcdf387258a93122b428cd9b3506f1dca11c1c2358a6eb26d\": container with ID starting with 6b67d625f3b2e98fcdf387258a93122b428cd9b3506f1dca11c1c2358a6eb26d not found: ID does not exist" containerID="6b67d625f3b2e98fcdf387258a93122b428cd9b3506f1dca11c1c2358a6eb26d" Oct 30 22:25:41.452204 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:41.452180 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b67d625f3b2e98fcdf387258a93122b428cd9b3506f1dca11c1c2358a6eb26d"} err="failed to get container status \"6b67d625f3b2e98fcdf387258a93122b428cd9b3506f1dca11c1c2358a6eb26d\": rpc error: code = NotFound desc = could not find container \"6b67d625f3b2e98fcdf387258a93122b428cd9b3506f1dca11c1c2358a6eb26d\": container with ID starting with 6b67d625f3b2e98fcdf387258a93122b428cd9b3506f1dca11c1c2358a6eb26d not found: ID does not exist" Oct 30 22:25:41.610926 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:41.610904 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx"] Oct 30 22:25:41.620695 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:41.620672 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-9b710916-sink-79f69849b4-bhgwx"] Oct 30 22:25:42.019999 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:25:42.019971 4497 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a6a15d_d957_4be3_8073_6b1f2913b0d8.slice/crio-6a0c15585252c4291421a22a304182ba042aff73f8840da8be5d8d9520f2ee0e\": RecentStats: unable to find data in memory cache]" Oct 30 22:25:42.020499 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:25:42.020102 4497 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a6a15d_d957_4be3_8073_6b1f2913b0d8.slice/crio-conmon-a090fc7172389fbd587eeb54379b23809f4a5db1f43e988caac1d227dbd37315.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a6a15d_d957_4be3_8073_6b1f2913b0d8.slice/crio-36181f0a072b51be5c5c9fe3d27cddaa7ce3c66c4274b90d01a63ff7a224ba6a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a6a15d_d957_4be3_8073_6b1f2913b0d8.slice/crio-6a0c15585252c4291421a22a304182ba042aff73f8840da8be5d8d9520f2ee0e\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a6a15d_d957_4be3_8073_6b1f2913b0d8.slice/crio-a090fc7172389fbd587eeb54379b23809f4a5db1f43e988caac1d227dbd37315.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e5dc6f4_d839_46e2_9a79_3f9349054be8.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e5dc6f4_d839_46e2_9a79_3f9349054be8.slice/crio-6b67d625f3b2e98fcdf387258a93122b428cd9b3506f1dca11c1c2358a6eb26d.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a6a15d_d957_4be3_8073_6b1f2913b0d8.slice/crio-conmon-36181f0a072b51be5c5c9fe3d27cddaa7ce3c66c4274b90d01a63ff7a224ba6a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e5dc6f4_d839_46e2_9a79_3f9349054be8.slice/crio-conmon-6b67d625f3b2e98fcdf387258a93122b428cd9b3506f1dca11c1c2358a6eb26d.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e5dc6f4_d839_46e2_9a79_3f9349054be8.slice/crio-fdf1e63b4bbb1dc9fa6e979cfcd6e1f471142cb3e2baa8bd4dd9433956c7dd9d\": RecentStats: unable to find data in memory cache]" Oct 30 22:25:42.151195 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.151171 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:25:42.251447 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.251395 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75a6a15d-d957-4be3-8073-6b1f2913b0d8-kube-api-access-wwnhf\" (UniqueName: \"kubernetes.io/projected/75a6a15d-d957-4be3-8073-6b1f2913b0d8-kube-api-access-wwnhf\") pod \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\" (UID: \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\") " Oct 30 22:25:42.251559 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.251458 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/75a6a15d-d957-4be3-8073-6b1f2913b0d8-proxy-tls\" (UniqueName: \"kubernetes.io/secret/75a6a15d-d957-4be3-8073-6b1f2913b0d8-proxy-tls\") pod \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\" (UID: \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\") " Oct 30 22:25:42.251559 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.251555 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a717ec2c915c82b3\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a717ec2c915c82b3\") pod \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\" (UID: \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\") " Oct 30 22:25:42.251675 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.251582 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/75a6a15d-d957-4be3-8073-6b1f2913b0d8-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/75a6a15d-d957-4be3-8073-6b1f2913b0d8-kube-rbac-proxy-sar-config\") pod \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\" (UID: \"75a6a15d-d957-4be3-8073-6b1f2913b0d8\") " Oct 30 22:25:42.251996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.251955 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75a6a15d-d957-4be3-8073-6b1f2913b0d8-kube-rbac-proxy-sar-config" pod "75a6a15d-d957-4be3-8073-6b1f2913b0d8" (UID: "75a6a15d-d957-4be3-8073-6b1f2913b0d8"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:25:42.253616 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.253588 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75a6a15d-d957-4be3-8073-6b1f2913b0d8-proxy-tls" pod "75a6a15d-d957-4be3-8073-6b1f2913b0d8" (UID: "75a6a15d-d957-4be3-8073-6b1f2913b0d8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:25:42.253741 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.253628 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75a6a15d-d957-4be3-8073-6b1f2913b0d8-kube-api-access-wwnhf" pod "75a6a15d-d957-4be3-8073-6b1f2913b0d8" (UID: "75a6a15d-d957-4be3-8073-6b1f2913b0d8"). InnerVolumeSpecName "kube-api-access-wwnhf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:25:42.254335 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.254315 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a717ec2c915c82b3" pod "75a6a15d-d957-4be3-8073-6b1f2913b0d8" (UID: "75a6a15d-d957-4be3-8073-6b1f2913b0d8"). InnerVolumeSpecName "pvc-dec0a744-c952-4511-9a80-791b293e3ace". PluginName "kubernetes.io/csi", VolumeGIDValue "" Oct 30 22:25:42.352759 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.352735 4497 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/75a6a15d-d957-4be3-8073-6b1f2913b0d8-proxy-tls\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:25:42.352848 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.352773 4497 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-dec0a744-c952-4511-9a80-791b293e3ace\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a717ec2c915c82b3\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" " Oct 30 22:25:42.352848 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.352785 4497 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/75a6a15d-d957-4be3-8073-6b1f2913b0d8-kube-rbac-proxy-sar-config\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:25:42.352848 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.352794 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwnhf\" (UniqueName: \"kubernetes.io/projected/75a6a15d-d957-4be3-8073-6b1f2913b0d8-kube-api-access-wwnhf\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:25:42.362035 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.362021 4497 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-dec0a744-c952-4511-9a80-791b293e3ace" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a717ec2c915c82b3") on node "ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:25:42.449773 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.449744 4497 generic.go:356] "Generic (PLEG): container finished" podID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerID="36181f0a072b51be5c5c9fe3d27cddaa7ce3c66c4274b90d01a63ff7a224ba6a" exitCode=0 Oct 30 22:25:42.449773 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.449769 4497 generic.go:356] "Generic (PLEG): container finished" podID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerID="a090fc7172389fbd587eeb54379b23809f4a5db1f43e988caac1d227dbd37315" exitCode=137 Oct 30 22:25:42.449919 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.449808 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" Oct 30 22:25:42.449919 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.449829 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" event={"ID":"75a6a15d-d957-4be3-8073-6b1f2913b0d8","Type":"ContainerDied","Data":"36181f0a072b51be5c5c9fe3d27cddaa7ce3c66c4274b90d01a63ff7a224ba6a"} Oct 30 22:25:42.449919 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.449905 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" event={"ID":"75a6a15d-d957-4be3-8073-6b1f2913b0d8","Type":"ContainerDied","Data":"a090fc7172389fbd587eeb54379b23809f4a5db1f43e988caac1d227dbd37315"} Oct 30 22:25:42.450039 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.449937 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x" event={"ID":"75a6a15d-d957-4be3-8073-6b1f2913b0d8","Type":"ContainerDied","Data":"6a0c15585252c4291421a22a304182ba042aff73f8840da8be5d8d9520f2ee0e"} Oct 30 22:25:42.450039 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.449970 4497 scope.go:122] "RemoveContainer" containerID="36181f0a072b51be5c5c9fe3d27cddaa7ce3c66c4274b90d01a63ff7a224ba6a" Oct 30 22:25:42.453031 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.453011 4497 reconciler_common.go:299] "Volume detached for volume \"pvc-dec0a744-c952-4511-9a80-791b293e3ace\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a717ec2c915c82b3\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"csi-4530b02d006f19c4a2bae08e5a551c095492084225305aa8bb7a4eee88b38444\"" Oct 30 22:25:42.458171 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.458158 4497 scope.go:122] "RemoveContainer" containerID="d77f1a942b511047051c484c2182b36e10b6756c6839f5905144921328ef767c" Oct 30 22:25:42.465044 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.465031 4497 scope.go:122] "RemoveContainer" containerID="a090fc7172389fbd587eeb54379b23809f4a5db1f43e988caac1d227dbd37315" Oct 30 22:25:42.471713 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.471697 4497 scope.go:122] "RemoveContainer" containerID="36181f0a072b51be5c5c9fe3d27cddaa7ce3c66c4274b90d01a63ff7a224ba6a" Oct 30 22:25:42.471993 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:25:42.471977 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36181f0a072b51be5c5c9fe3d27cddaa7ce3c66c4274b90d01a63ff7a224ba6a\": container with ID starting with 36181f0a072b51be5c5c9fe3d27cddaa7ce3c66c4274b90d01a63ff7a224ba6a not found: ID does not exist" containerID="36181f0a072b51be5c5c9fe3d27cddaa7ce3c66c4274b90d01a63ff7a224ba6a" Oct 30 22:25:42.472037 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.472000 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36181f0a072b51be5c5c9fe3d27cddaa7ce3c66c4274b90d01a63ff7a224ba6a"} err="failed to get container status \"36181f0a072b51be5c5c9fe3d27cddaa7ce3c66c4274b90d01a63ff7a224ba6a\": rpc error: code = NotFound desc = could not find container \"36181f0a072b51be5c5c9fe3d27cddaa7ce3c66c4274b90d01a63ff7a224ba6a\": container with ID starting with 36181f0a072b51be5c5c9fe3d27cddaa7ce3c66c4274b90d01a63ff7a224ba6a not found: ID does not exist" Oct 30 22:25:42.472037 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.472016 4497 scope.go:122] "RemoveContainer" containerID="d77f1a942b511047051c484c2182b36e10b6756c6839f5905144921328ef767c" Oct 30 22:25:42.472273 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:25:42.472256 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d77f1a942b511047051c484c2182b36e10b6756c6839f5905144921328ef767c\": container with ID starting with d77f1a942b511047051c484c2182b36e10b6756c6839f5905144921328ef767c not found: ID does not exist" containerID="d77f1a942b511047051c484c2182b36e10b6756c6839f5905144921328ef767c" Oct 30 22:25:42.472313 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.472277 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d77f1a942b511047051c484c2182b36e10b6756c6839f5905144921328ef767c"} err="failed to get container status \"d77f1a942b511047051c484c2182b36e10b6756c6839f5905144921328ef767c\": rpc error: code = NotFound desc = could not find container \"d77f1a942b511047051c484c2182b36e10b6756c6839f5905144921328ef767c\": container with ID starting with d77f1a942b511047051c484c2182b36e10b6756c6839f5905144921328ef767c not found: ID does not exist" Oct 30 22:25:42.472313 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.472291 4497 scope.go:122] "RemoveContainer" containerID="a090fc7172389fbd587eeb54379b23809f4a5db1f43e988caac1d227dbd37315" Oct 30 22:25:42.472490 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:25:42.472475 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a090fc7172389fbd587eeb54379b23809f4a5db1f43e988caac1d227dbd37315\": container with ID starting with a090fc7172389fbd587eeb54379b23809f4a5db1f43e988caac1d227dbd37315 not found: ID does not exist" containerID="a090fc7172389fbd587eeb54379b23809f4a5db1f43e988caac1d227dbd37315" Oct 30 22:25:42.472527 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.472494 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a090fc7172389fbd587eeb54379b23809f4a5db1f43e988caac1d227dbd37315"} err="failed to get container status \"a090fc7172389fbd587eeb54379b23809f4a5db1f43e988caac1d227dbd37315\": rpc error: code = NotFound desc = could not find container \"a090fc7172389fbd587eeb54379b23809f4a5db1f43e988caac1d227dbd37315\": container with ID starting with a090fc7172389fbd587eeb54379b23809f4a5db1f43e988caac1d227dbd37315 not found: ID does not exist" Oct 30 22:25:42.472527 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.472505 4497 scope.go:122] "RemoveContainer" containerID="36181f0a072b51be5c5c9fe3d27cddaa7ce3c66c4274b90d01a63ff7a224ba6a" Oct 30 22:25:42.472712 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.472696 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36181f0a072b51be5c5c9fe3d27cddaa7ce3c66c4274b90d01a63ff7a224ba6a"} err="failed to get container status \"36181f0a072b51be5c5c9fe3d27cddaa7ce3c66c4274b90d01a63ff7a224ba6a\": rpc error: code = NotFound desc = could not find container \"36181f0a072b51be5c5c9fe3d27cddaa7ce3c66c4274b90d01a63ff7a224ba6a\": container with ID starting with 36181f0a072b51be5c5c9fe3d27cddaa7ce3c66c4274b90d01a63ff7a224ba6a not found: ID does not exist" Oct 30 22:25:42.472787 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.472712 4497 scope.go:122] "RemoveContainer" containerID="d77f1a942b511047051c484c2182b36e10b6756c6839f5905144921328ef767c" Oct 30 22:25:42.472935 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.472912 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d77f1a942b511047051c484c2182b36e10b6756c6839f5905144921328ef767c"} err="failed to get container status \"d77f1a942b511047051c484c2182b36e10b6756c6839f5905144921328ef767c\": rpc error: code = NotFound desc = could not find container \"d77f1a942b511047051c484c2182b36e10b6756c6839f5905144921328ef767c\": container with ID starting with d77f1a942b511047051c484c2182b36e10b6756c6839f5905144921328ef767c not found: ID does not exist" Oct 30 22:25:42.472935 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.472934 4497 scope.go:122] "RemoveContainer" containerID="a090fc7172389fbd587eeb54379b23809f4a5db1f43e988caac1d227dbd37315" Oct 30 22:25:42.473172 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.473157 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a090fc7172389fbd587eeb54379b23809f4a5db1f43e988caac1d227dbd37315"} err="failed to get container status \"a090fc7172389fbd587eeb54379b23809f4a5db1f43e988caac1d227dbd37315\": rpc error: code = NotFound desc = could not find container \"a090fc7172389fbd587eeb54379b23809f4a5db1f43e988caac1d227dbd37315\": container with ID starting with a090fc7172389fbd587eeb54379b23809f4a5db1f43e988caac1d227dbd37315 not found: ID does not exist" Oct 30 22:25:42.619719 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.619663 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x"] Oct 30 22:25:42.625156 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.625137 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-9b710916-predictor-86c4c4d744-jm68x"] Oct 30 22:25:42.846658 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:42.846620 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:43.115008 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:43.114977 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:43.540049 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:43.540015 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" path="/var/lib/kubelet/pods/75a6a15d-d957-4be3-8073-6b1f2913b0d8/volumes" Oct 30 22:25:43.540453 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:43.540437 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7e5dc6f4-d839-46e2-9a79-3f9349054be8" path="/var/lib/kubelet/pods/7e5dc6f4-d839-46e2-9a79-3f9349054be8/volumes" Oct 30 22:25:44.939377 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:44.939341 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:45.107065 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.107033 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9"] Oct 30 22:25:45.107375 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.107361 4497 cpu_manager.go:414] "containerMap: removing container" podUID="2c6ec608-8a33-47f6-baf1-46325de68524" containerName="kserve-container" Oct 30 22:25:45.107427 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.107376 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2c6ec608-8a33-47f6-baf1-46325de68524" containerName="kserve-container" Oct 30 22:25:45.107427 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.107394 4497 cpu_manager.go:414] "containerMap: removing container" podUID="2c6ec608-8a33-47f6-baf1-46325de68524" containerName="kube-rbac-proxy" Oct 30 22:25:45.107427 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.107400 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2c6ec608-8a33-47f6-baf1-46325de68524" containerName="kube-rbac-proxy" Oct 30 22:25:45.107427 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.107407 4497 cpu_manager.go:414] "containerMap: removing container" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="kserve-container" Oct 30 22:25:45.107427 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.107413 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="kserve-container" Oct 30 22:25:45.107427 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.107420 4497 cpu_manager.go:414] "containerMap: removing container" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="agent" Oct 30 22:25:45.107427 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.107425 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="agent" Oct 30 22:25:45.107724 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.107440 4497 cpu_manager.go:414] "containerMap: removing container" podUID="7e5dc6f4-d839-46e2-9a79-3f9349054be8" containerName="kserve-container" Oct 30 22:25:45.107724 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.107445 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e5dc6f4-d839-46e2-9a79-3f9349054be8" containerName="kserve-container" Oct 30 22:25:45.107724 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.107455 4497 cpu_manager.go:414] "containerMap: removing container" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="kube-rbac-proxy" Oct 30 22:25:45.107724 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.107460 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="kube-rbac-proxy" Oct 30 22:25:45.107724 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.107533 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="2c6ec608-8a33-47f6-baf1-46325de68524" containerName="kserve-container" Oct 30 22:25:45.107724 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.107544 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="2c6ec608-8a33-47f6-baf1-46325de68524" containerName="kube-rbac-proxy" Oct 30 22:25:45.107724 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.107549 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="kserve-container" Oct 30 22:25:45.107724 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.107557 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="agent" Oct 30 22:25:45.107724 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.107562 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="7e5dc6f4-d839-46e2-9a79-3f9349054be8" containerName="kserve-container" Oct 30 22:25:45.107724 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.107568 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="75a6a15d-d957-4be3-8073-6b1f2913b0d8" containerName="kube-rbac-proxy" Oct 30 22:25:45.112288 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.112264 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9" Oct 30 22:25:45.166330 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.166312 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"kube-root-ca.crt\"" Oct 30 22:25:45.166330 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.166312 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"openshift-service-ca.crt\"" Oct 30 22:25:45.171537 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.171512 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjnds\" (UniqueName: \"kubernetes.io/projected/6591acfb-ec82-40bb-aad3-8dd217bc296a-kube-api-access-hjnds\") pod \"proxy-routing-772470c1-sink-56c669ffd4-rvrp9\" (UID: \"6591acfb-ec82-40bb-aad3-8dd217bc296a\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9" Oct 30 22:25:45.215519 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.215472 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"default-dockercfg-s9cqw\"" Oct 30 22:25:45.216797 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.216778 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9"] Oct 30 22:25:45.272788 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.272760 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjnds\" (UniqueName: \"kubernetes.io/projected/6591acfb-ec82-40bb-aad3-8dd217bc296a-kube-api-access-hjnds\") pod \"proxy-routing-772470c1-sink-56c669ffd4-rvrp9\" (UID: \"6591acfb-ec82-40bb-aad3-8dd217bc296a\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9" Oct 30 22:25:45.280339 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.280320 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:45.335084 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.335061 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjnds\" (UniqueName: \"kubernetes.io/projected/6591acfb-ec82-40bb-aad3-8dd217bc296a-kube-api-access-hjnds\") pod \"proxy-routing-772470c1-sink-56c669ffd4-rvrp9\" (UID: \"6591acfb-ec82-40bb-aad3-8dd217bc296a\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9" Oct 30 22:25:45.426169 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.426145 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9" Oct 30 22:25:45.795723 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:45.795698 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9"] Oct 30 22:25:45.797699 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:25:45.797679 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6591acfb_ec82_40bb_aad3_8dd217bc296a.slice/crio-81201d78d9a45ea212b4a1e273ef3993f4427aebe1e83daf9cc05e28af4f80d0 WatchSource:0}: Error finding container 81201d78d9a45ea212b4a1e273ef3993f4427aebe1e83daf9cc05e28af4f80d0: Status 404 returned error can't find the container with id 81201d78d9a45ea212b4a1e273ef3993f4427aebe1e83daf9cc05e28af4f80d0 Oct 30 22:25:46.471665 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:46.471629 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9" event={"ID":"6591acfb-ec82-40bb-aad3-8dd217bc296a","Type":"ContainerStarted","Data":"a6276e8fa72b31d0c5581301797a0f2ef45b21efa459949e3aafb78255f8417c"} Oct 30 22:25:46.472120 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:46.471687 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9" event={"ID":"6591acfb-ec82-40bb-aad3-8dd217bc296a","Type":"ContainerStarted","Data":"81201d78d9a45ea212b4a1e273ef3993f4427aebe1e83daf9cc05e28af4f80d0"} Oct 30 22:25:46.472120 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:46.471815 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9" Oct 30 22:25:46.474167 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:46.474149 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9" Oct 30 22:25:46.595605 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:46.595554 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9" podStartSLOduration=1.595541598 podStartE2EDuration="1.595541598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:25:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:25:46.593609843 +0000 UTC m=+1041.220675392" watchObservedRunningTime="2026-10-30 22:25:46.595541598 +0000 UTC m=+1041.222607147" Oct 30 22:25:49.018588 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:49.018555 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:49.361521 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:49.361430 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:49.624506 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:49.624442 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:51.741281 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:51.741233 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:52.057927 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:52.057839 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:52.155372 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:52.155346 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h"] Oct 30 22:25:52.158941 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:52.158925 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:25:52.213192 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:52.213168 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"proxy-routing-772470c1-dockercfg-jv52t\"" Oct 30 22:25:52.222481 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:52.222442 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/990f591b-36a7-459d-a189-8908963c9fca-kube-rbac-proxy-sar-config\") pod \"proxy-routing-772470c1-predictor-689fdd8cb-9jv8h\" (UID: \"990f591b-36a7-459d-a189-8908963c9fca\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:25:52.222610 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:52.222581 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9hv4\" (UniqueName: \"kubernetes.io/projected/990f591b-36a7-459d-a189-8908963c9fca-kube-api-access-d9hv4\") pod \"proxy-routing-772470c1-predictor-689fdd8cb-9jv8h\" (UID: \"990f591b-36a7-459d-a189-8908963c9fca\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:25:52.222729 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:52.222636 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/990f591b-36a7-459d-a189-8908963c9fca-proxy-tls\") pod \"proxy-routing-772470c1-predictor-689fdd8cb-9jv8h\" (UID: \"990f591b-36a7-459d-a189-8908963c9fca\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:25:52.262498 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:52.262479 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"proxy-routing-772470c1-predictor-serving-cert\"" Oct 30 22:25:52.262593 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:52.262535 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"proxy-routing-772470c1-kube-rbac-proxy-sar-config\"" Oct 30 22:25:52.263729 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:52.263712 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h"] Oct 30 22:25:52.323666 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:52.323614 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9hv4\" (UniqueName: \"kubernetes.io/projected/990f591b-36a7-459d-a189-8908963c9fca-kube-api-access-d9hv4\") pod \"proxy-routing-772470c1-predictor-689fdd8cb-9jv8h\" (UID: \"990f591b-36a7-459d-a189-8908963c9fca\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:25:52.323666 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:52.323645 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/990f591b-36a7-459d-a189-8908963c9fca-proxy-tls\") pod \"proxy-routing-772470c1-predictor-689fdd8cb-9jv8h\" (UID: \"990f591b-36a7-459d-a189-8908963c9fca\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:25:52.323830 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:52.323672 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/990f591b-36a7-459d-a189-8908963c9fca-kube-rbac-proxy-sar-config\") pod \"proxy-routing-772470c1-predictor-689fdd8cb-9jv8h\" (UID: \"990f591b-36a7-459d-a189-8908963c9fca\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:25:52.324361 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:52.324306 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/990f591b-36a7-459d-a189-8908963c9fca-kube-rbac-proxy-sar-config\") pod \"proxy-routing-772470c1-predictor-689fdd8cb-9jv8h\" (UID: \"990f591b-36a7-459d-a189-8908963c9fca\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:25:52.326071 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:52.326051 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/990f591b-36a7-459d-a189-8908963c9fca-proxy-tls\") pod \"proxy-routing-772470c1-predictor-689fdd8cb-9jv8h\" (UID: \"990f591b-36a7-459d-a189-8908963c9fca\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:25:52.383752 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:52.383725 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:52.386207 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:52.386181 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9hv4\" (UniqueName: \"kubernetes.io/projected/990f591b-36a7-459d-a189-8908963c9fca-kube-api-access-d9hv4\") pod \"proxy-routing-772470c1-predictor-689fdd8cb-9jv8h\" (UID: \"990f591b-36a7-459d-a189-8908963c9fca\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:25:58.104189 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:58.104149 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:58.379863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:25:58.379833 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:59.653853 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:25:59.653813 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:26:01.186777 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:01.186750 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b038eafe-6bbb-41b8-aae5-ad1759a2d228\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a45a4de6042edae0\") pod \"proxy-routing-772470c1-predictor-689fdd8cb-9jv8h\" (UID: \"990f591b-36a7-459d-a189-8908963c9fca\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:26:01.292154 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:01.292123 4497 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b038eafe-6bbb-41b8-aae5-ad1759a2d228\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a45a4de6042edae0\") pod \"proxy-routing-772470c1-predictor-689fdd8cb-9jv8h\" (UID: \"990f591b-36a7-459d-a189-8908963c9fca\") device path: \"\"" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:26:01.388520 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:01.388495 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b038eafe-6bbb-41b8-aae5-ad1759a2d228\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a45a4de6042edae0\") pod \"proxy-routing-772470c1-predictor-689fdd8cb-9jv8h\" (UID: \"990f591b-36a7-459d-a189-8908963c9fca\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:26:01.388612 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:01.388585 4497 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b038eafe-6bbb-41b8-aae5-ad1759a2d228\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a45a4de6042edae0\") pod \"proxy-routing-772470c1-predictor-689fdd8cb-9jv8h\" (UID: \"990f591b-36a7-459d-a189-8908963c9fca\") DevicePath \"\"" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:26:01.441133 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:01.441081 4497 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b038eafe-6bbb-41b8-aae5-ad1759a2d228\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a45a4de6042edae0\") pod \"proxy-routing-772470c1-predictor-689fdd8cb-9jv8h\" (UID: \"990f591b-36a7-459d-a189-8908963c9fca\") DevicePath \"csi-543acd056e7fcfcf8bc995b95772dc057adfeac0b5dc71c7fe194190e9fa7d09\"" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:26:01.652827 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:01.652799 4497 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b038eafe-6bbb-41b8-aae5-ad1759a2d228\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a45a4de6042edae0\") pod \"proxy-routing-772470c1-predictor-689fdd8cb-9jv8h\" (UID: \"990f591b-36a7-459d-a189-8908963c9fca\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/352cb1edef912e194c532466046d6cc50cb210ea48aea84d70697f8e6e31e655/globalmount\"" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:26:01.715710 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:01.715653 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b038eafe-6bbb-41b8-aae5-ad1759a2d228\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a45a4de6042edae0\") pod \"proxy-routing-772470c1-predictor-689fdd8cb-9jv8h\" (UID: \"990f591b-36a7-459d-a189-8908963c9fca\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:26:01.772562 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:01.772535 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:26:02.192326 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:02.192301 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h"] Oct 30 22:26:02.194664 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:26:02.194640 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod990f591b_36a7_459d_a189_8908963c9fca.slice/crio-187d9605f001ca951993f9ef194df555a3202fea5fa5876b159ad46948cfc15b WatchSource:0}: Error finding container 187d9605f001ca951993f9ef194df555a3202fea5fa5876b159ad46948cfc15b: Status 404 returned error can't find the container with id 187d9605f001ca951993f9ef194df555a3202fea5fa5876b159ad46948cfc15b Oct 30 22:26:02.535040 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:02.534954 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" event={"ID":"990f591b-36a7-459d-a189-8908963c9fca","Type":"ContainerStarted","Data":"a78a5d4e87fb8123c4ea981f4391195f5f2124e6aa13a057c9f41c252dccdb27"} Oct 30 22:26:02.535040 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:02.535008 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:26:02.535040 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:02.535028 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" event={"ID":"990f591b-36a7-459d-a189-8908963c9fca","Type":"ContainerStarted","Data":"a322b6e7f865bc06f4c245640236f25026d3824731b220b8a846b748c48ae547"} Oct 30 22:26:02.535306 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:02.535052 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" event={"ID":"990f591b-36a7-459d-a189-8908963c9fca","Type":"ContainerStarted","Data":"187d9605f001ca951993f9ef194df555a3202fea5fa5876b159ad46948cfc15b"} Oct 30 22:26:02.535306 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:02.535070 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:26:02.537353 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:02.537330 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:26:02.656258 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:02.656199 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" podStartSLOduration=13.656186938 podStartE2EDuration="13.656186938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:25:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:26:02.655191313 +0000 UTC m=+1057.282256864" watchObservedRunningTime="2026-10-30 22:26:02.656186938 +0000 UTC m=+1057.283252488" Oct 30 22:26:09.548839 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:09.548813 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:26:18.246215 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:18.246173 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:18.581838 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:18.581730 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:19.156434 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:19.156392 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl"] Oct 30 22:26:19.159949 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:19.159930 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:19.217581 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:19.217552 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/48fdff65-581d-4b4f-b128-67b3af4c2026-kube-rbac-proxy-sar-config\") pod \"proxy-routing-772470c1-predictor-f649bfb9b-zzthl\" (UID: \"48fdff65-581d-4b4f-b128-67b3af4c2026\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:19.217703 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:19.217588 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48fdff65-581d-4b4f-b128-67b3af4c2026-proxy-tls\") pod \"proxy-routing-772470c1-predictor-f649bfb9b-zzthl\" (UID: \"48fdff65-581d-4b4f-b128-67b3af4c2026\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:19.217756 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:19.217734 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb4sb\" (UniqueName: \"kubernetes.io/projected/48fdff65-581d-4b4f-b128-67b3af4c2026-kube-api-access-sb4sb\") pod \"proxy-routing-772470c1-predictor-f649bfb9b-zzthl\" (UID: \"48fdff65-581d-4b4f-b128-67b3af4c2026\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:19.264379 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:19.264352 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl"] Oct 30 22:26:19.318805 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:19.318778 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/48fdff65-581d-4b4f-b128-67b3af4c2026-kube-rbac-proxy-sar-config\") pod \"proxy-routing-772470c1-predictor-f649bfb9b-zzthl\" (UID: \"48fdff65-581d-4b4f-b128-67b3af4c2026\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:19.318911 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:19.318813 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48fdff65-581d-4b4f-b128-67b3af4c2026-proxy-tls\") pod \"proxy-routing-772470c1-predictor-f649bfb9b-zzthl\" (UID: \"48fdff65-581d-4b4f-b128-67b3af4c2026\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:19.318911 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:19.318832 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b038eafe-6bbb-41b8-aae5-ad1759a2d228\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a45a4de6042edae0\") pod \"proxy-routing-772470c1-predictor-f649bfb9b-zzthl\" (UID: \"48fdff65-581d-4b4f-b128-67b3af4c2026\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:19.318911 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:19.318875 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb4sb\" (UniqueName: \"kubernetes.io/projected/48fdff65-581d-4b4f-b128-67b3af4c2026-kube-api-access-sb4sb\") pod \"proxy-routing-772470c1-predictor-f649bfb9b-zzthl\" (UID: \"48fdff65-581d-4b4f-b128-67b3af4c2026\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:19.319019 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:19.319000 4497 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b038eafe-6bbb-41b8-aae5-ad1759a2d228\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a45a4de6042edae0\") pod \"proxy-routing-772470c1-predictor-f649bfb9b-zzthl\" (UID: \"48fdff65-581d-4b4f-b128-67b3af4c2026\") DevicePath \"csi-543acd056e7fcfcf8bc995b95772dc057adfeac0b5dc71c7fe194190e9fa7d09\"" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:19.319505 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:19.319488 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/48fdff65-581d-4b4f-b128-67b3af4c2026-kube-rbac-proxy-sar-config\") pod \"proxy-routing-772470c1-predictor-f649bfb9b-zzthl\" (UID: \"48fdff65-581d-4b4f-b128-67b3af4c2026\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:19.321266 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:19.321231 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48fdff65-581d-4b4f-b128-67b3af4c2026-proxy-tls\") pod \"proxy-routing-772470c1-predictor-f649bfb9b-zzthl\" (UID: \"48fdff65-581d-4b4f-b128-67b3af4c2026\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:19.371585 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:19.371559 4497 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b038eafe-6bbb-41b8-aae5-ad1759a2d228\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a45a4de6042edae0\") pod \"proxy-routing-772470c1-predictor-f649bfb9b-zzthl\" (UID: \"48fdff65-581d-4b4f-b128-67b3af4c2026\") DevicePath \"csi-543acd056e7fcfcf8bc995b95772dc057adfeac0b5dc71c7fe194190e9fa7d09\"" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:19.380847 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:19.380826 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb4sb\" (UniqueName: \"kubernetes.io/projected/48fdff65-581d-4b4f-b128-67b3af4c2026-kube-api-access-sb4sb\") pod \"proxy-routing-772470c1-predictor-f649bfb9b-zzthl\" (UID: \"48fdff65-581d-4b4f-b128-67b3af4c2026\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:19.431656 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:19.431601 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b038eafe-6bbb-41b8-aae5-ad1759a2d228\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a45a4de6042edae0\") pod \"proxy-routing-772470c1-predictor-f649bfb9b-zzthl\" (UID: \"48fdff65-581d-4b4f-b128-67b3af4c2026\") " pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:19.777426 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:19.777347 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:20.207770 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:20.207746 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl"] Oct 30 22:26:20.209728 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:26:20.209703 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48fdff65_581d_4b4f_b128_67b3af4c2026.slice/crio-a4753422dacfb9629b469c3a31561d107432eb5509801eee06b60ee10f7c95ad WatchSource:0}: Error finding container a4753422dacfb9629b469c3a31561d107432eb5509801eee06b60ee10f7c95ad: Status 404 returned error can't find the container with id a4753422dacfb9629b469c3a31561d107432eb5509801eee06b60ee10f7c95ad Oct 30 22:26:20.604797 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:20.604711 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" event={"ID":"48fdff65-581d-4b4f-b128-67b3af4c2026","Type":"ContainerStarted","Data":"aaa9d59dbce839f63b4570438007d419eeccb9f6e3bf9992af5683239b8036f4"} Oct 30 22:26:20.604797 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:20.604785 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" event={"ID":"48fdff65-581d-4b4f-b128-67b3af4c2026","Type":"ContainerStarted","Data":"00353f967a8a929077e16ad8a8b744bd60ddc4291d344f4496203464ea1b7faf"} Oct 30 22:26:20.605279 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:20.604823 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:20.605279 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:20.604859 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:20.605279 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:20.604897 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" event={"ID":"48fdff65-581d-4b4f-b128-67b3af4c2026","Type":"ContainerStarted","Data":"b4f54dfad8806c4b81c258634c96d5749688f50e86121a64a2698623fe9cf790"} Oct 30 22:26:20.605279 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:20.604934 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:20.605279 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:20.604976 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" event={"ID":"48fdff65-581d-4b4f-b128-67b3af4c2026","Type":"ContainerStarted","Data":"a4753422dacfb9629b469c3a31561d107432eb5509801eee06b60ee10f7c95ad"} Oct 30 22:26:20.607268 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:20.607224 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:20.607740 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:20.607725 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:20.742483 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:20.742419 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" podStartSLOduration=1.742406208 podStartE2EDuration="1.742406208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:26:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:26:20.741995228 +0000 UTC m=+1075.369060777" watchObservedRunningTime="2026-10-30 22:26:20.742406208 +0000 UTC m=+1075.369471755" Oct 30 22:26:27.616512 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:27.616484 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:26:27.839962 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:27.839927 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h"] Oct 30 22:26:27.840279 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:27.840201 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" podUID="990f591b-36a7-459d-a189-8908963c9fca" containerName="kserve-container" containerID="cri-o://a322b6e7f865bc06f4c245640236f25026d3824731b220b8a846b748c48ae547" gracePeriod=30 Oct 30 22:26:27.840485 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:27.840261 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" podUID="990f591b-36a7-459d-a189-8908963c9fca" containerName="kube-rbac-proxy" containerID="cri-o://a78a5d4e87fb8123c4ea981f4391195f5f2124e6aa13a057c9f41c252dccdb27" gracePeriod=30 Oct 30 22:26:28.637378 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:28.637347 4497 generic.go:356] "Generic (PLEG): container finished" podID="990f591b-36a7-459d-a189-8908963c9fca" containerID="a78a5d4e87fb8123c4ea981f4391195f5f2124e6aa13a057c9f41c252dccdb27" exitCode=0 Oct 30 22:26:28.637754 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:28.637410 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" event={"ID":"990f591b-36a7-459d-a189-8908963c9fca","Type":"ContainerDied","Data":"a78a5d4e87fb8123c4ea981f4391195f5f2124e6aa13a057c9f41c252dccdb27"} Oct 30 22:26:29.544827 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:29.544791 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" podUID="990f591b-36a7-459d-a189-8908963c9fca" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.30:8643/healthz\": dial tcp 10.133.0.30:8643: connect: connection refused" Oct 30 22:26:29.653696 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:26:29.653664 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:26:34.545294 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:34.545226 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" podUID="990f591b-36a7-459d-a189-8908963c9fca" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.30:8643/healthz\": dial tcp 10.133.0.30:8643: connect: connection refused" Oct 30 22:26:39.544882 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:39.544845 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" podUID="990f591b-36a7-459d-a189-8908963c9fca" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.30:8643/healthz\": dial tcp 10.133.0.30:8643: connect: connection refused" Oct 30 22:26:39.545340 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:39.544946 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:26:44.545342 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:44.545294 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" podUID="990f591b-36a7-459d-a189-8908963c9fca" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.30:8643/healthz\": dial tcp 10.133.0.30:8643: connect: connection refused" Oct 30 22:26:49.545059 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:49.545019 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" podUID="990f591b-36a7-459d-a189-8908963c9fca" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.30:8643/healthz\": dial tcp 10.133.0.30:8643: connect: connection refused" Oct 30 22:26:54.544488 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:54.544441 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" podUID="990f591b-36a7-459d-a189-8908963c9fca" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.30:8643/healthz\": dial tcp 10.133.0.30:8643: connect: connection refused" Oct 30 22:26:58.028018 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.027997 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:26:58.120035 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.119971 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/990f591b-36a7-459d-a189-8908963c9fca-kube-api-access-d9hv4\" (UniqueName: \"kubernetes.io/projected/990f591b-36a7-459d-a189-8908963c9fca-kube-api-access-d9hv4\") pod \"990f591b-36a7-459d-a189-8908963c9fca\" (UID: \"990f591b-36a7-459d-a189-8908963c9fca\") " Oct 30 22:26:58.120035 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.120022 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/990f591b-36a7-459d-a189-8908963c9fca-proxy-tls\" (UniqueName: \"kubernetes.io/secret/990f591b-36a7-459d-a189-8908963c9fca-proxy-tls\") pod \"990f591b-36a7-459d-a189-8908963c9fca\" (UID: \"990f591b-36a7-459d-a189-8908963c9fca\") " Oct 30 22:26:58.120213 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.120102 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/990f591b-36a7-459d-a189-8908963c9fca-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/990f591b-36a7-459d-a189-8908963c9fca-kube-rbac-proxy-sar-config\") pod \"990f591b-36a7-459d-a189-8908963c9fca\" (UID: \"990f591b-36a7-459d-a189-8908963c9fca\") " Oct 30 22:26:58.120303 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.120212 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a45a4de6042edae0\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a45a4de6042edae0\") pod \"990f591b-36a7-459d-a189-8908963c9fca\" (UID: \"990f591b-36a7-459d-a189-8908963c9fca\") " Oct 30 22:26:58.120470 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.120444 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/990f591b-36a7-459d-a189-8908963c9fca-kube-rbac-proxy-sar-config" pod "990f591b-36a7-459d-a189-8908963c9fca" (UID: "990f591b-36a7-459d-a189-8908963c9fca"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:26:58.122186 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.122157 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/990f591b-36a7-459d-a189-8908963c9fca-kube-api-access-d9hv4" pod "990f591b-36a7-459d-a189-8908963c9fca" (UID: "990f591b-36a7-459d-a189-8908963c9fca"). InnerVolumeSpecName "kube-api-access-d9hv4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:26:58.122186 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.122180 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/990f591b-36a7-459d-a189-8908963c9fca-proxy-tls" pod "990f591b-36a7-459d-a189-8908963c9fca" (UID: "990f591b-36a7-459d-a189-8908963c9fca"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:26:58.123142 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.123122 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a45a4de6042edae0" pod "990f591b-36a7-459d-a189-8908963c9fca" (UID: "990f591b-36a7-459d-a189-8908963c9fca"). InnerVolumeSpecName "pvc-b038eafe-6bbb-41b8-aae5-ad1759a2d228". PluginName "kubernetes.io/csi", VolumeGIDValue "" Oct 30 22:26:58.221583 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.221563 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9hv4\" (UniqueName: \"kubernetes.io/projected/990f591b-36a7-459d-a189-8908963c9fca-kube-api-access-d9hv4\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:26:58.221583 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.221583 4497 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/990f591b-36a7-459d-a189-8908963c9fca-proxy-tls\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:26:58.221706 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.221592 4497 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/990f591b-36a7-459d-a189-8908963c9fca-kube-rbac-proxy-sar-config\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:26:58.769106 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.769071 4497 generic.go:356] "Generic (PLEG): container finished" podID="990f591b-36a7-459d-a189-8908963c9fca" containerID="a322b6e7f865bc06f4c245640236f25026d3824731b220b8a846b748c48ae547" exitCode=137 Oct 30 22:26:58.769297 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.769132 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" event={"ID":"990f591b-36a7-459d-a189-8908963c9fca","Type":"ContainerDied","Data":"a322b6e7f865bc06f4c245640236f25026d3824731b220b8a846b748c48ae547"} Oct 30 22:26:58.769297 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.769203 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" Oct 30 22:26:58.769297 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.769220 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h" event={"ID":"990f591b-36a7-459d-a189-8908963c9fca","Type":"ContainerDied","Data":"187d9605f001ca951993f9ef194df555a3202fea5fa5876b159ad46948cfc15b"} Oct 30 22:26:58.769297 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.769254 4497 scope.go:122] "RemoveContainer" containerID="a78a5d4e87fb8123c4ea981f4391195f5f2124e6aa13a057c9f41c252dccdb27" Oct 30 22:26:58.778261 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.778227 4497 scope.go:122] "RemoveContainer" containerID="a322b6e7f865bc06f4c245640236f25026d3824731b220b8a846b748c48ae547" Oct 30 22:26:58.787880 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.787864 4497 scope.go:122] "RemoveContainer" containerID="a78a5d4e87fb8123c4ea981f4391195f5f2124e6aa13a057c9f41c252dccdb27" Oct 30 22:26:58.788154 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:26:58.788133 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a78a5d4e87fb8123c4ea981f4391195f5f2124e6aa13a057c9f41c252dccdb27\": container with ID starting with a78a5d4e87fb8123c4ea981f4391195f5f2124e6aa13a057c9f41c252dccdb27 not found: ID does not exist" containerID="a78a5d4e87fb8123c4ea981f4391195f5f2124e6aa13a057c9f41c252dccdb27" Oct 30 22:26:58.788207 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.788161 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a78a5d4e87fb8123c4ea981f4391195f5f2124e6aa13a057c9f41c252dccdb27"} err="failed to get container status \"a78a5d4e87fb8123c4ea981f4391195f5f2124e6aa13a057c9f41c252dccdb27\": rpc error: code = NotFound desc = could not find container \"a78a5d4e87fb8123c4ea981f4391195f5f2124e6aa13a057c9f41c252dccdb27\": container with ID starting with a78a5d4e87fb8123c4ea981f4391195f5f2124e6aa13a057c9f41c252dccdb27 not found: ID does not exist" Oct 30 22:26:58.788207 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.788178 4497 scope.go:122] "RemoveContainer" containerID="a322b6e7f865bc06f4c245640236f25026d3824731b220b8a846b748c48ae547" Oct 30 22:26:58.788461 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:26:58.788442 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a322b6e7f865bc06f4c245640236f25026d3824731b220b8a846b748c48ae547\": container with ID starting with a322b6e7f865bc06f4c245640236f25026d3824731b220b8a846b748c48ae547 not found: ID does not exist" containerID="a322b6e7f865bc06f4c245640236f25026d3824731b220b8a846b748c48ae547" Oct 30 22:26:58.788540 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.788471 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a322b6e7f865bc06f4c245640236f25026d3824731b220b8a846b748c48ae547"} err="failed to get container status \"a322b6e7f865bc06f4c245640236f25026d3824731b220b8a846b748c48ae547\": rpc error: code = NotFound desc = could not find container \"a322b6e7f865bc06f4c245640236f25026d3824731b220b8a846b748c48ae547\": container with ID starting with a322b6e7f865bc06f4c245640236f25026d3824731b220b8a846b748c48ae547 not found: ID does not exist" Oct 30 22:26:58.986163 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.986137 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h"] Oct 30 22:26:58.994589 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:58.994564 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-689fdd8cb-9jv8h"] Oct 30 22:26:59.539313 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:26:59.539284 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="990f591b-36a7-459d-a189-8908963c9fca" path="/var/lib/kubelet/pods/990f591b-36a7-459d-a189-8908963c9fca/volumes" Oct 30 22:26:59.655282 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:26:59.655226 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:27:05.221885 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:05.221855 4497 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-959ee2f135_proxy-routing-772470c1-predictor-f649bfb9b-zzthl_48fdff65-581d-4b4f-b128-67b3af4c2026/kserve-container/0.log" Oct 30 22:27:05.456556 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:05.456518 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9"] Oct 30 22:27:05.456765 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:05.456744 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9" podUID="6591acfb-ec82-40bb-aad3-8dd217bc296a" containerName="kserve-container" containerID="cri-o://a6276e8fa72b31d0c5581301797a0f2ef45b21efa459949e3aafb78255f8417c" gracePeriod=30 Oct 30 22:27:05.650911 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:05.650876 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:05.980456 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:05.980360 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:07.278910 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:07.278876 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:07.713735 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:07.713708 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl"] Oct 30 22:27:07.713966 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:07.713934 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="kserve-container" containerID="cri-o://b4f54dfad8806c4b81c258634c96d5749688f50e86121a64a2698623fe9cf790" gracePeriod=30 Oct 30 22:27:07.713966 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:07.713957 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="agent" containerID="cri-o://aaa9d59dbce839f63b4570438007d419eeccb9f6e3bf9992af5683239b8036f4" gracePeriod=30 Oct 30 22:27:07.714152 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:07.714003 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="kube-rbac-proxy" containerID="cri-o://00353f967a8a929077e16ad8a8b744bd60ddc4291d344f4496203464ea1b7faf" gracePeriod=30 Oct 30 22:27:07.848570 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:07.848533 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:08.815255 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:08.815212 4497 generic.go:356] "Generic (PLEG): container finished" podID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerID="00353f967a8a929077e16ad8a8b744bd60ddc4291d344f4496203464ea1b7faf" exitCode=0 Oct 30 22:27:08.815643 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:08.815277 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" event={"ID":"48fdff65-581d-4b4f-b128-67b3af4c2026","Type":"ContainerDied","Data":"00353f967a8a929077e16ad8a8b744bd60ddc4291d344f4496203464ea1b7faf"} Oct 30 22:27:10.605952 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:10.605913 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:27:12.613534 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:12.613499 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.31:8643/healthz\": dial tcp 10.133.0.31:8643: connect: connection refused" Oct 30 22:27:15.281862 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:15.281829 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:15.544347 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:15.544252 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:17.613157 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:17.613123 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.31:8643/healthz\": dial tcp 10.133.0.31:8643: connect: connection refused" Oct 30 22:27:18.586876 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:18.586844 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:20.605711 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:20.605649 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:27:22.613597 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:22.613551 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.31:8643/healthz\": dial tcp 10.133.0.31:8643: connect: connection refused" Oct 30 22:27:22.614117 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:22.613674 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:27:27.613656 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:27.613617 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.31:8643/healthz\": dial tcp 10.133.0.31:8643: connect: connection refused" Oct 30 22:27:29.656397 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:27:29.656358 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:27:30.605960 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:30.605921 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:27:30.606129 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:30.606058 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:27:32.612681 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:32.612627 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.31:8643/healthz\": dial tcp 10.133.0.31:8643: connect: connection refused" Oct 30 22:27:35.624605 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:35.624581 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9" Oct 30 22:27:35.800573 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:35.800499 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6591acfb-ec82-40bb-aad3-8dd217bc296a-kube-api-access-hjnds\" (UniqueName: \"kubernetes.io/projected/6591acfb-ec82-40bb-aad3-8dd217bc296a-kube-api-access-hjnds\") pod \"6591acfb-ec82-40bb-aad3-8dd217bc296a\" (UID: \"6591acfb-ec82-40bb-aad3-8dd217bc296a\") " Oct 30 22:27:35.802607 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:35.802587 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6591acfb-ec82-40bb-aad3-8dd217bc296a-kube-api-access-hjnds" pod "6591acfb-ec82-40bb-aad3-8dd217bc296a" (UID: "6591acfb-ec82-40bb-aad3-8dd217bc296a"). InnerVolumeSpecName "kube-api-access-hjnds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:27:35.901942 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:35.901919 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjnds\" (UniqueName: \"kubernetes.io/projected/6591acfb-ec82-40bb-aad3-8dd217bc296a-kube-api-access-hjnds\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:27:35.920957 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:35.920928 4497 generic.go:356] "Generic (PLEG): container finished" podID="6591acfb-ec82-40bb-aad3-8dd217bc296a" containerID="a6276e8fa72b31d0c5581301797a0f2ef45b21efa459949e3aafb78255f8417c" exitCode=137 Oct 30 22:27:35.921080 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:35.920982 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9" event={"ID":"6591acfb-ec82-40bb-aad3-8dd217bc296a","Type":"ContainerDied","Data":"a6276e8fa72b31d0c5581301797a0f2ef45b21efa459949e3aafb78255f8417c"} Oct 30 22:27:35.921080 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:35.921022 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9" Oct 30 22:27:35.921080 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:35.921028 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9" event={"ID":"6591acfb-ec82-40bb-aad3-8dd217bc296a","Type":"ContainerDied","Data":"81201d78d9a45ea212b4a1e273ef3993f4427aebe1e83daf9cc05e28af4f80d0"} Oct 30 22:27:35.921080 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:35.921055 4497 scope.go:122] "RemoveContainer" containerID="a6276e8fa72b31d0c5581301797a0f2ef45b21efa459949e3aafb78255f8417c" Oct 30 22:27:35.921336 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:35.921188 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:35.929041 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:35.929024 4497 scope.go:122] "RemoveContainer" containerID="a6276e8fa72b31d0c5581301797a0f2ef45b21efa459949e3aafb78255f8417c" Oct 30 22:27:35.929313 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:27:35.929291 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6276e8fa72b31d0c5581301797a0f2ef45b21efa459949e3aafb78255f8417c\": container with ID starting with a6276e8fa72b31d0c5581301797a0f2ef45b21efa459949e3aafb78255f8417c not found: ID does not exist" containerID="a6276e8fa72b31d0c5581301797a0f2ef45b21efa459949e3aafb78255f8417c" Oct 30 22:27:35.929406 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:35.929319 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6276e8fa72b31d0c5581301797a0f2ef45b21efa459949e3aafb78255f8417c"} err="failed to get container status \"a6276e8fa72b31d0c5581301797a0f2ef45b21efa459949e3aafb78255f8417c\": rpc error: code = NotFound desc = could not find container \"a6276e8fa72b31d0c5581301797a0f2ef45b21efa459949e3aafb78255f8417c\": container with ID starting with a6276e8fa72b31d0c5581301797a0f2ef45b21efa459949e3aafb78255f8417c not found: ID does not exist" Oct 30 22:27:36.087437 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:36.087387 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9"] Oct 30 22:27:36.092865 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:36.092844 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-772470c1-sink-56c669ffd4-rvrp9"] Oct 30 22:27:36.827006 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:36.826970 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:37.100958 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.100865 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:37.539127 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.539096 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6591acfb-ec82-40bb-aad3-8dd217bc296a" path="/var/lib/kubelet/pods/6591acfb-ec82-40bb-aad3-8dd217bc296a/volumes" Oct 30 22:27:37.612669 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.612639 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.31:8643/healthz\": dial tcp 10.133.0.31:8643: connect: connection refused" Oct 30 22:27:37.887084 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.887063 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:27:37.930996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.930968 4497 generic.go:356] "Generic (PLEG): container finished" podID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerID="aaa9d59dbce839f63b4570438007d419eeccb9f6e3bf9992af5683239b8036f4" exitCode=0 Oct 30 22:27:37.930996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.930992 4497 generic.go:356] "Generic (PLEG): container finished" podID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerID="b4f54dfad8806c4b81c258634c96d5749688f50e86121a64a2698623fe9cf790" exitCode=137 Oct 30 22:27:37.931144 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.931028 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" event={"ID":"48fdff65-581d-4b4f-b128-67b3af4c2026","Type":"ContainerDied","Data":"aaa9d59dbce839f63b4570438007d419eeccb9f6e3bf9992af5683239b8036f4"} Oct 30 22:27:37.931144 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.931073 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" event={"ID":"48fdff65-581d-4b4f-b128-67b3af4c2026","Type":"ContainerDied","Data":"b4f54dfad8806c4b81c258634c96d5749688f50e86121a64a2698623fe9cf790"} Oct 30 22:27:37.931144 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.931097 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" event={"ID":"48fdff65-581d-4b4f-b128-67b3af4c2026","Type":"ContainerDied","Data":"a4753422dacfb9629b469c3a31561d107432eb5509801eee06b60ee10f7c95ad"} Oct 30 22:27:37.931144 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.931029 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl" Oct 30 22:27:37.931144 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.931122 4497 scope.go:122] "RemoveContainer" containerID="aaa9d59dbce839f63b4570438007d419eeccb9f6e3bf9992af5683239b8036f4" Oct 30 22:27:37.938655 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.938636 4497 scope.go:122] "RemoveContainer" containerID="00353f967a8a929077e16ad8a8b744bd60ddc4291d344f4496203464ea1b7faf" Oct 30 22:27:37.945742 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.945728 4497 scope.go:122] "RemoveContainer" containerID="b4f54dfad8806c4b81c258634c96d5749688f50e86121a64a2698623fe9cf790" Oct 30 22:27:37.952413 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.952400 4497 scope.go:122] "RemoveContainer" containerID="aaa9d59dbce839f63b4570438007d419eeccb9f6e3bf9992af5683239b8036f4" Oct 30 22:27:37.952634 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:27:37.952619 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaa9d59dbce839f63b4570438007d419eeccb9f6e3bf9992af5683239b8036f4\": container with ID starting with aaa9d59dbce839f63b4570438007d419eeccb9f6e3bf9992af5683239b8036f4 not found: ID does not exist" containerID="aaa9d59dbce839f63b4570438007d419eeccb9f6e3bf9992af5683239b8036f4" Oct 30 22:27:37.952678 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.952643 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaa9d59dbce839f63b4570438007d419eeccb9f6e3bf9992af5683239b8036f4"} err="failed to get container status \"aaa9d59dbce839f63b4570438007d419eeccb9f6e3bf9992af5683239b8036f4\": rpc error: code = NotFound desc = could not find container \"aaa9d59dbce839f63b4570438007d419eeccb9f6e3bf9992af5683239b8036f4\": container with ID starting with aaa9d59dbce839f63b4570438007d419eeccb9f6e3bf9992af5683239b8036f4 not found: ID does not exist" Oct 30 22:27:37.952678 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.952658 4497 scope.go:122] "RemoveContainer" containerID="00353f967a8a929077e16ad8a8b744bd60ddc4291d344f4496203464ea1b7faf" Oct 30 22:27:37.952918 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:27:37.952896 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00353f967a8a929077e16ad8a8b744bd60ddc4291d344f4496203464ea1b7faf\": container with ID starting with 00353f967a8a929077e16ad8a8b744bd60ddc4291d344f4496203464ea1b7faf not found: ID does not exist" containerID="00353f967a8a929077e16ad8a8b744bd60ddc4291d344f4496203464ea1b7faf" Oct 30 22:27:37.952981 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.952928 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00353f967a8a929077e16ad8a8b744bd60ddc4291d344f4496203464ea1b7faf"} err="failed to get container status \"00353f967a8a929077e16ad8a8b744bd60ddc4291d344f4496203464ea1b7faf\": rpc error: code = NotFound desc = could not find container \"00353f967a8a929077e16ad8a8b744bd60ddc4291d344f4496203464ea1b7faf\": container with ID starting with 00353f967a8a929077e16ad8a8b744bd60ddc4291d344f4496203464ea1b7faf not found: ID does not exist" Oct 30 22:27:37.952981 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.952950 4497 scope.go:122] "RemoveContainer" containerID="b4f54dfad8806c4b81c258634c96d5749688f50e86121a64a2698623fe9cf790" Oct 30 22:27:37.953170 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:27:37.953153 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4f54dfad8806c4b81c258634c96d5749688f50e86121a64a2698623fe9cf790\": container with ID starting with b4f54dfad8806c4b81c258634c96d5749688f50e86121a64a2698623fe9cf790 not found: ID does not exist" containerID="b4f54dfad8806c4b81c258634c96d5749688f50e86121a64a2698623fe9cf790" Oct 30 22:27:37.953228 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.953176 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4f54dfad8806c4b81c258634c96d5749688f50e86121a64a2698623fe9cf790"} err="failed to get container status \"b4f54dfad8806c4b81c258634c96d5749688f50e86121a64a2698623fe9cf790\": rpc error: code = NotFound desc = could not find container \"b4f54dfad8806c4b81c258634c96d5749688f50e86121a64a2698623fe9cf790\": container with ID starting with b4f54dfad8806c4b81c258634c96d5749688f50e86121a64a2698623fe9cf790 not found: ID does not exist" Oct 30 22:27:37.953228 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.953194 4497 scope.go:122] "RemoveContainer" containerID="aaa9d59dbce839f63b4570438007d419eeccb9f6e3bf9992af5683239b8036f4" Oct 30 22:27:37.953452 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.953434 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaa9d59dbce839f63b4570438007d419eeccb9f6e3bf9992af5683239b8036f4"} err="failed to get container status \"aaa9d59dbce839f63b4570438007d419eeccb9f6e3bf9992af5683239b8036f4\": rpc error: code = NotFound desc = could not find container \"aaa9d59dbce839f63b4570438007d419eeccb9f6e3bf9992af5683239b8036f4\": container with ID starting with aaa9d59dbce839f63b4570438007d419eeccb9f6e3bf9992af5683239b8036f4 not found: ID does not exist" Oct 30 22:27:37.953510 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.953454 4497 scope.go:122] "RemoveContainer" containerID="00353f967a8a929077e16ad8a8b744bd60ddc4291d344f4496203464ea1b7faf" Oct 30 22:27:37.953694 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.953678 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00353f967a8a929077e16ad8a8b744bd60ddc4291d344f4496203464ea1b7faf"} err="failed to get container status \"00353f967a8a929077e16ad8a8b744bd60ddc4291d344f4496203464ea1b7faf\": rpc error: code = NotFound desc = could not find container \"00353f967a8a929077e16ad8a8b744bd60ddc4291d344f4496203464ea1b7faf\": container with ID starting with 00353f967a8a929077e16ad8a8b744bd60ddc4291d344f4496203464ea1b7faf not found: ID does not exist" Oct 30 22:27:37.953750 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.953694 4497 scope.go:122] "RemoveContainer" containerID="b4f54dfad8806c4b81c258634c96d5749688f50e86121a64a2698623fe9cf790" Oct 30 22:27:37.953902 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:37.953886 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4f54dfad8806c4b81c258634c96d5749688f50e86121a64a2698623fe9cf790"} err="failed to get container status \"b4f54dfad8806c4b81c258634c96d5749688f50e86121a64a2698623fe9cf790\": rpc error: code = NotFound desc = could not find container \"b4f54dfad8806c4b81c258634c96d5749688f50e86121a64a2698623fe9cf790\": container with ID starting with b4f54dfad8806c4b81c258634c96d5749688f50e86121a64a2698623fe9cf790 not found: ID does not exist" Oct 30 22:27:38.018179 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:38.018156 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/48fdff65-581d-4b4f-b128-67b3af4c2026-proxy-tls\" (UniqueName: \"kubernetes.io/secret/48fdff65-581d-4b4f-b128-67b3af4c2026-proxy-tls\") pod \"48fdff65-581d-4b4f-b128-67b3af4c2026\" (UID: \"48fdff65-581d-4b4f-b128-67b3af4c2026\") " Oct 30 22:27:38.018256 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:38.018231 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/48fdff65-581d-4b4f-b128-67b3af4c2026-kube-api-access-sb4sb\" (UniqueName: \"kubernetes.io/projected/48fdff65-581d-4b4f-b128-67b3af4c2026-kube-api-access-sb4sb\") pod \"48fdff65-581d-4b4f-b128-67b3af4c2026\" (UID: \"48fdff65-581d-4b4f-b128-67b3af4c2026\") " Oct 30 22:27:38.018344 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:38.018330 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a45a4de6042edae0\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a45a4de6042edae0\") pod \"48fdff65-581d-4b4f-b128-67b3af4c2026\" (UID: \"48fdff65-581d-4b4f-b128-67b3af4c2026\") " Oct 30 22:27:38.018405 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:38.018371 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/48fdff65-581d-4b4f-b128-67b3af4c2026-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/48fdff65-581d-4b4f-b128-67b3af4c2026-kube-rbac-proxy-sar-config\") pod \"48fdff65-581d-4b4f-b128-67b3af4c2026\" (UID: \"48fdff65-581d-4b4f-b128-67b3af4c2026\") " Oct 30 22:27:38.018783 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:38.018756 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48fdff65-581d-4b4f-b128-67b3af4c2026-kube-rbac-proxy-sar-config" pod "48fdff65-581d-4b4f-b128-67b3af4c2026" (UID: "48fdff65-581d-4b4f-b128-67b3af4c2026"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:27:38.020211 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:38.020187 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48fdff65-581d-4b4f-b128-67b3af4c2026-proxy-tls" pod "48fdff65-581d-4b4f-b128-67b3af4c2026" (UID: "48fdff65-581d-4b4f-b128-67b3af4c2026"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:27:38.020360 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:38.020342 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48fdff65-581d-4b4f-b128-67b3af4c2026-kube-api-access-sb4sb" pod "48fdff65-581d-4b4f-b128-67b3af4c2026" (UID: "48fdff65-581d-4b4f-b128-67b3af4c2026"). InnerVolumeSpecName "kube-api-access-sb4sb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:27:38.021091 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:38.021075 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a45a4de6042edae0" pod "48fdff65-581d-4b4f-b128-67b3af4c2026" (UID: "48fdff65-581d-4b4f-b128-67b3af4c2026"). InnerVolumeSpecName "pvc-b038eafe-6bbb-41b8-aae5-ad1759a2d228". PluginName "kubernetes.io/csi", VolumeGIDValue "" Oct 30 22:27:38.119413 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:38.119359 4497 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48fdff65-581d-4b4f-b128-67b3af4c2026-proxy-tls\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:27:38.119413 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:38.119383 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sb4sb\" (UniqueName: \"kubernetes.io/projected/48fdff65-581d-4b4f-b128-67b3af4c2026-kube-api-access-sb4sb\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:27:38.119564 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:38.119414 4497 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b038eafe-6bbb-41b8-aae5-ad1759a2d228\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a45a4de6042edae0\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" " Oct 30 22:27:38.119564 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:38.119428 4497 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/48fdff65-581d-4b4f-b128-67b3af4c2026-kube-rbac-proxy-sar-config\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:27:38.128947 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:38.128930 4497 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b038eafe-6bbb-41b8-aae5-ad1759a2d228" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a45a4de6042edae0") on node "ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:27:38.219948 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:38.219927 4497 reconciler_common.go:299] "Volume detached for volume \"pvc-b038eafe-6bbb-41b8-aae5-ad1759a2d228\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a45a4de6042edae0\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"csi-543acd056e7fcfcf8bc995b95772dc057adfeac0b5dc71c7fe194190e9fa7d09\"" Oct 30 22:27:38.352050 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:38.352023 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl"] Oct 30 22:27:38.356532 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:38.356506 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-772470c1-predictor-f649bfb9b-zzthl"] Oct 30 22:27:38.550639 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:38.550608 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:38.815750 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:38.815684 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:39.539890 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:39.539860 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" path="/var/lib/kubelet/pods/48fdff65-581d-4b4f-b128-67b3af4c2026/volumes" Oct 30 22:27:40.385986 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.385952 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:40.661834 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.661759 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:40.766074 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.766044 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk"] Oct 30 22:27:40.766354 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.766340 4497 cpu_manager.go:414] "containerMap: removing container" podUID="6591acfb-ec82-40bb-aad3-8dd217bc296a" containerName="kserve-container" Oct 30 22:27:40.766409 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.766356 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6591acfb-ec82-40bb-aad3-8dd217bc296a" containerName="kserve-container" Oct 30 22:27:40.766409 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.766369 4497 cpu_manager.go:414] "containerMap: removing container" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="kube-rbac-proxy" Oct 30 22:27:40.766409 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.766377 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="kube-rbac-proxy" Oct 30 22:27:40.766409 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.766387 4497 cpu_manager.go:414] "containerMap: removing container" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="agent" Oct 30 22:27:40.766409 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.766392 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="agent" Oct 30 22:27:40.766409 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.766404 4497 cpu_manager.go:414] "containerMap: removing container" podUID="990f591b-36a7-459d-a189-8908963c9fca" containerName="kube-rbac-proxy" Oct 30 22:27:40.766409 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.766408 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="990f591b-36a7-459d-a189-8908963c9fca" containerName="kube-rbac-proxy" Oct 30 22:27:40.766645 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.766415 4497 cpu_manager.go:414] "containerMap: removing container" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="kserve-container" Oct 30 22:27:40.766645 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.766420 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="kserve-container" Oct 30 22:27:40.766645 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.766428 4497 cpu_manager.go:414] "containerMap: removing container" podUID="990f591b-36a7-459d-a189-8908963c9fca" containerName="kserve-container" Oct 30 22:27:40.766645 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.766432 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="990f591b-36a7-459d-a189-8908963c9fca" containerName="kserve-container" Oct 30 22:27:40.766645 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.766494 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="990f591b-36a7-459d-a189-8908963c9fca" containerName="kube-rbac-proxy" Oct 30 22:27:40.766645 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.766501 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="kserve-container" Oct 30 22:27:40.766645 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.766509 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="990f591b-36a7-459d-a189-8908963c9fca" containerName="kserve-container" Oct 30 22:27:40.766645 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.766516 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="6591acfb-ec82-40bb-aad3-8dd217bc296a" containerName="kserve-container" Oct 30 22:27:40.766645 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.766523 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="kube-rbac-proxy" Oct 30 22:27:40.766645 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.766527 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="48fdff65-581d-4b4f-b128-67b3af4c2026" containerName="agent" Oct 30 22:27:40.770822 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.770806 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk" Oct 30 22:27:40.824372 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.824352 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"openshift-service-ca.crt\"" Oct 30 22:27:40.873430 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.873404 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"default-dockercfg-s9cqw\"" Oct 30 22:27:40.873555 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.873455 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"kube-root-ca.crt\"" Oct 30 22:27:40.874578 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.874556 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk"] Oct 30 22:27:40.925337 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.925256 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:40.939249 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:40.939215 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch9qg\" (UniqueName: \"kubernetes.io/projected/fca8ced6-3dac-4509-98ca-94d87f1163de-kube-api-access-ch9qg\") pod \"proxy-routing-3b596750-sink-68455f6f94-mkbwk\" (UID: \"fca8ced6-3dac-4509-98ca-94d87f1163de\") " pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk" Oct 30 22:27:41.040283 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:41.040260 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch9qg\" (UniqueName: \"kubernetes.io/projected/fca8ced6-3dac-4509-98ca-94d87f1163de-kube-api-access-ch9qg\") pod \"proxy-routing-3b596750-sink-68455f6f94-mkbwk\" (UID: \"fca8ced6-3dac-4509-98ca-94d87f1163de\") " pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk" Oct 30 22:27:41.118995 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:41.118967 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch9qg\" (UniqueName: \"kubernetes.io/projected/fca8ced6-3dac-4509-98ca-94d87f1163de-kube-api-access-ch9qg\") pod \"proxy-routing-3b596750-sink-68455f6f94-mkbwk\" (UID: \"fca8ced6-3dac-4509-98ca-94d87f1163de\") " pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk" Oct 30 22:27:41.251751 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:41.251681 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:41.384490 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:41.384467 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk" Oct 30 22:27:41.754153 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:41.754124 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk"] Oct 30 22:27:41.757759 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:27:41.757729 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfca8ced6_3dac_4509_98ca_94d87f1163de.slice/crio-20286229ee42a28f6d618d5cadeccdfc91b7094c5ad37e91602f9b6252e4015f WatchSource:0}: Error finding container 20286229ee42a28f6d618d5cadeccdfc91b7094c5ad37e91602f9b6252e4015f: Status 404 returned error can't find the container with id 20286229ee42a28f6d618d5cadeccdfc91b7094c5ad37e91602f9b6252e4015f Oct 30 22:27:41.948618 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:41.948588 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk" event={"ID":"fca8ced6-3dac-4509-98ca-94d87f1163de","Type":"ContainerStarted","Data":"4ba3bcb8b2a14c6299a7a1ba87984f49ece535bcfffbab344ad22cac4a86ccf6"} Oct 30 22:27:41.948731 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:41.948633 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk" event={"ID":"fca8ced6-3dac-4509-98ca-94d87f1163de","Type":"ContainerStarted","Data":"20286229ee42a28f6d618d5cadeccdfc91b7094c5ad37e91602f9b6252e4015f"} Oct 30 22:27:41.948801 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:41.948749 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk" Oct 30 22:27:41.949995 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:41.949967 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk" podUID="fca8ced6-3dac-4509-98ca-94d87f1163de" containerName="kserve-container" probeResult="failure" output="Get \"http://10.133.0.32:8080/\": dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:27:42.064146 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:42.064065 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk" podStartSLOduration=2.064052374 podStartE2EDuration="2.064052374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:27:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:27:42.063877337 +0000 UTC m=+1156.690942897" watchObservedRunningTime="2026-10-30 22:27:42.064052374 +0000 UTC m=+1156.691117923" Oct 30 22:27:42.953995 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:42.953965 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk" Oct 30 22:27:45.585596 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:45.585556 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:45.895787 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:45.895759 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:46.168051 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:46.167975 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:48.732997 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:48.732961 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc"] Oct 30 22:27:48.736353 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:48.736333 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:48.791701 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:48.791677 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"proxy-routing-3b596750-predictor-serving-cert\"" Oct 30 22:27:48.838894 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:48.838869 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"proxy-routing-3b596750-kube-rbac-proxy-sar-config\"" Oct 30 22:27:48.838894 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:48.838889 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"proxy-routing-3b596750-dockercfg-qzc9g\"" Oct 30 22:27:48.840284 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:48.840263 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc"] Oct 30 22:27:48.892009 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:48.891985 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jwmz\" (UniqueName: \"kubernetes.io/projected/c71afa1e-a709-4d23-9056-e20deb9dfd5e-kube-api-access-2jwmz\") pod \"proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc\" (UID: \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\") " pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:48.892098 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:48.892014 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c71afa1e-a709-4d23-9056-e20deb9dfd5e-proxy-tls\") pod \"proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc\" (UID: \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\") " pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:48.892098 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:48.892037 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c71afa1e-a709-4d23-9056-e20deb9dfd5e-kube-rbac-proxy-sar-config\") pod \"proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc\" (UID: \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\") " pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:48.992461 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:48.992412 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jwmz\" (UniqueName: \"kubernetes.io/projected/c71afa1e-a709-4d23-9056-e20deb9dfd5e-kube-api-access-2jwmz\") pod \"proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc\" (UID: \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\") " pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:48.992461 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:48.992439 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c71afa1e-a709-4d23-9056-e20deb9dfd5e-proxy-tls\") pod \"proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc\" (UID: \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\") " pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:48.992461 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:48.992459 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c71afa1e-a709-4d23-9056-e20deb9dfd5e-kube-rbac-proxy-sar-config\") pod \"proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc\" (UID: \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\") " pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:48.993102 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:48.993082 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c71afa1e-a709-4d23-9056-e20deb9dfd5e-kube-rbac-proxy-sar-config\") pod \"proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc\" (UID: \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\") " pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:48.995043 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:48.995003 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c71afa1e-a709-4d23-9056-e20deb9dfd5e-proxy-tls\") pod \"proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc\" (UID: \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\") " pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:49.054808 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:49.054779 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jwmz\" (UniqueName: \"kubernetes.io/projected/c71afa1e-a709-4d23-9056-e20deb9dfd5e-kube-api-access-2jwmz\") pod \"proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc\" (UID: \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\") " pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:49.229357 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:49.229333 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:49.507773 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:49.507730 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:53.794845 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:53.794794 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:54.067578 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:54.067476 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:54.325838 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:54.325757 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-d7fb5af1-9b8f-4132-af5d-0b32ec1f000c\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a813c820b512db2d\") pod \"proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc\" (UID: \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\") " pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:54.431089 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:54.431053 4497 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-d7fb5af1-9b8f-4132-af5d-0b32ec1f000c\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a813c820b512db2d\") pod \"proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc\" (UID: \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\") device path: \"\"" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:54.527601 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:54.527566 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-d7fb5af1-9b8f-4132-af5d-0b32ec1f000c\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a813c820b512db2d\") pod \"proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc\" (UID: \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\") " pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:54.527730 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:54.527703 4497 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-d7fb5af1-9b8f-4132-af5d-0b32ec1f000c\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a813c820b512db2d\") pod \"proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc\" (UID: \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\") DevicePath \"\"" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:54.580175 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:54.580108 4497 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-d7fb5af1-9b8f-4132-af5d-0b32ec1f000c\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a813c820b512db2d\") pod \"proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc\" (UID: \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\") DevicePath \"csi-8add7cdafe4a56cee966616e86a738a97f1836260d05eadb7415e05431f4c573\"" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:54.784291 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:54.784265 4497 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-d7fb5af1-9b8f-4132-af5d-0b32ec1f000c\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a813c820b512db2d\") pod \"proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc\" (UID: \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/fef442aeb1ade38d5652619561d3cba29d6346e02460b21e7d53a17cc2819e3c/globalmount\"" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:54.845913 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:54.845864 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-d7fb5af1-9b8f-4132-af5d-0b32ec1f000c\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a813c820b512db2d\") pod \"proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc\" (UID: \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\") " pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:55.050048 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:55.050024 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:55.494081 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:55.494055 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc"] Oct 30 22:27:55.496599 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:27:55.496566 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc71afa1e_a709_4d23_9056_e20deb9dfd5e.slice/crio-792fdc1b7a5074a942da030d8219b6448325d2572947c42b88b401cd0f1eba46 WatchSource:0}: Error finding container 792fdc1b7a5074a942da030d8219b6448325d2572947c42b88b401cd0f1eba46: Status 404 returned error can't find the container with id 792fdc1b7a5074a942da030d8219b6448325d2572947c42b88b401cd0f1eba46 Oct 30 22:27:56.003629 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:56.003594 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" event={"ID":"c71afa1e-a709-4d23-9056-e20deb9dfd5e","Type":"ContainerStarted","Data":"6be65248ffa21bccd2eccd0d78223deb618f7178cf3d512d39e92841d9b017fe"} Oct 30 22:27:56.004010 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:56.003673 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" event={"ID":"c71afa1e-a709-4d23-9056-e20deb9dfd5e","Type":"ContainerStarted","Data":"a62d5e1fb6580ded07c14adf8a98ee22e4e30384ba467ee8a878cbc8b928265a"} Oct 30 22:27:56.004010 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:56.003691 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" event={"ID":"c71afa1e-a709-4d23-9056-e20deb9dfd5e","Type":"ContainerStarted","Data":"792fdc1b7a5074a942da030d8219b6448325d2572947c42b88b401cd0f1eba46"} Oct 30 22:27:56.004010 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:56.003868 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:56.004010 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:56.003892 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:56.006195 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:56.006174 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:27:56.122671 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:27:56.122630 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" podStartSLOduration=11.122615682 podStartE2EDuration="11.122615682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:27:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:27:56.122423008 +0000 UTC m=+1170.749488558" watchObservedRunningTime="2026-10-30 22:27:56.122615682 +0000 UTC m=+1170.749681234" Oct 30 22:27:59.655653 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:27:59.655538 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:28:03.016111 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:28:03.016075 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:28:03.116066 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:28:03.116031 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:28:03.380818 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:28:03.380760 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:28:18.930540 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:28:18.930497 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:28:29.655108 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:28:29.655071 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:28:35.488589 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:28:35.488561 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk"] Oct 30 22:28:35.488963 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:28:35.488727 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk" podUID="fca8ced6-3dac-4509-98ca-94d87f1163de" containerName="kserve-container" containerID="cri-o://4ba3bcb8b2a14c6299a7a1ba87984f49ece535bcfffbab344ad22cac4a86ccf6" gracePeriod=30 Oct 30 22:28:35.537644 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:28:35.537607 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:28:35.883687 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:28:35.883642 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:28:36.658663 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:28:36.658633 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc"] Oct 30 22:28:36.659047 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:28:36.658841 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" podUID="c71afa1e-a709-4d23-9056-e20deb9dfd5e" containerName="kserve-container" containerID="cri-o://a62d5e1fb6580ded07c14adf8a98ee22e4e30384ba467ee8a878cbc8b928265a" gracePeriod=30 Oct 30 22:28:36.659047 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:28:36.658899 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" podUID="c71afa1e-a709-4d23-9056-e20deb9dfd5e" containerName="kube-rbac-proxy" containerID="cri-o://6be65248ffa21bccd2eccd0d78223deb618f7178cf3d512d39e92841d9b017fe" gracePeriod=30 Oct 30 22:28:36.800891 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:28:36.796574 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:28:37.163487 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:28:37.163462 4497 generic.go:356] "Generic (PLEG): container finished" podID="c71afa1e-a709-4d23-9056-e20deb9dfd5e" containerID="6be65248ffa21bccd2eccd0d78223deb618f7178cf3d512d39e92841d9b017fe" exitCode=0 Oct 30 22:28:37.163620 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:28:37.163532 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" event={"ID":"c71afa1e-a709-4d23-9056-e20deb9dfd5e","Type":"ContainerDied","Data":"6be65248ffa21bccd2eccd0d78223deb618f7178cf3d512d39e92841d9b017fe"} Oct 30 22:28:38.012539 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:28:38.012499 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" podUID="c71afa1e-a709-4d23-9056-e20deb9dfd5e" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.33:8643/healthz\": dial tcp 10.133.0.33:8643: connect: connection refused" Oct 30 22:28:43.012358 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:28:43.012313 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" podUID="c71afa1e-a709-4d23-9056-e20deb9dfd5e" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.33:8643/healthz\": dial tcp 10.133.0.33:8643: connect: connection refused" Oct 30 22:28:48.011604 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:28:48.011556 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" podUID="c71afa1e-a709-4d23-9056-e20deb9dfd5e" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.33:8643/healthz\": dial tcp 10.133.0.33:8643: connect: connection refused" Oct 30 22:28:48.012074 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:28:48.011683 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:28:53.012053 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:28:53.012012 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" podUID="c71afa1e-a709-4d23-9056-e20deb9dfd5e" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.33:8643/healthz\": dial tcp 10.133.0.33:8643: connect: connection refused" Oct 30 22:28:58.012104 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:28:58.012063 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" podUID="c71afa1e-a709-4d23-9056-e20deb9dfd5e" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.33:8643/healthz\": dial tcp 10.133.0.33:8643: connect: connection refused" Oct 30 22:28:59.655420 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:28:59.655379 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:29:01.128825 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:01.128786 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:03.012460 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:03.012411 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" podUID="c71afa1e-a709-4d23-9056-e20deb9dfd5e" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.33:8643/healthz\": dial tcp 10.133.0.33:8643: connect: connection refused" Oct 30 22:29:05.655040 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:05.655013 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk" Oct 30 22:29:05.728291 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:05.728269 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fca8ced6-3dac-4509-98ca-94d87f1163de-kube-api-access-ch9qg\" (UniqueName: \"kubernetes.io/projected/fca8ced6-3dac-4509-98ca-94d87f1163de-kube-api-access-ch9qg\") pod \"fca8ced6-3dac-4509-98ca-94d87f1163de\" (UID: \"fca8ced6-3dac-4509-98ca-94d87f1163de\") " Oct 30 22:29:05.730289 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:05.730267 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fca8ced6-3dac-4509-98ca-94d87f1163de-kube-api-access-ch9qg" pod "fca8ced6-3dac-4509-98ca-94d87f1163de" (UID: "fca8ced6-3dac-4509-98ca-94d87f1163de"). InnerVolumeSpecName "kube-api-access-ch9qg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:29:05.829725 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:05.829669 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ch9qg\" (UniqueName: \"kubernetes.io/projected/fca8ced6-3dac-4509-98ca-94d87f1163de-kube-api-access-ch9qg\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:29:06.280458 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:06.280428 4497 generic.go:356] "Generic (PLEG): container finished" podID="fca8ced6-3dac-4509-98ca-94d87f1163de" containerID="4ba3bcb8b2a14c6299a7a1ba87984f49ece535bcfffbab344ad22cac4a86ccf6" exitCode=137 Oct 30 22:29:06.280630 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:06.280471 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk" Oct 30 22:29:06.280630 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:06.280505 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk" event={"ID":"fca8ced6-3dac-4509-98ca-94d87f1163de","Type":"ContainerDied","Data":"4ba3bcb8b2a14c6299a7a1ba87984f49ece535bcfffbab344ad22cac4a86ccf6"} Oct 30 22:29:06.280630 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:06.280554 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk" event={"ID":"fca8ced6-3dac-4509-98ca-94d87f1163de","Type":"ContainerDied","Data":"20286229ee42a28f6d618d5cadeccdfc91b7094c5ad37e91602f9b6252e4015f"} Oct 30 22:29:06.280630 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:06.280576 4497 scope.go:122] "RemoveContainer" containerID="4ba3bcb8b2a14c6299a7a1ba87984f49ece535bcfffbab344ad22cac4a86ccf6" Oct 30 22:29:06.288552 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:06.288537 4497 scope.go:122] "RemoveContainer" containerID="4ba3bcb8b2a14c6299a7a1ba87984f49ece535bcfffbab344ad22cac4a86ccf6" Oct 30 22:29:06.288827 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:29:06.288808 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ba3bcb8b2a14c6299a7a1ba87984f49ece535bcfffbab344ad22cac4a86ccf6\": container with ID starting with 4ba3bcb8b2a14c6299a7a1ba87984f49ece535bcfffbab344ad22cac4a86ccf6 not found: ID does not exist" containerID="4ba3bcb8b2a14c6299a7a1ba87984f49ece535bcfffbab344ad22cac4a86ccf6" Oct 30 22:29:06.288865 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:06.288837 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ba3bcb8b2a14c6299a7a1ba87984f49ece535bcfffbab344ad22cac4a86ccf6"} err="failed to get container status \"4ba3bcb8b2a14c6299a7a1ba87984f49ece535bcfffbab344ad22cac4a86ccf6\": rpc error: code = NotFound desc = could not find container \"4ba3bcb8b2a14c6299a7a1ba87984f49ece535bcfffbab344ad22cac4a86ccf6\": container with ID starting with 4ba3bcb8b2a14c6299a7a1ba87984f49ece535bcfffbab344ad22cac4a86ccf6 not found: ID does not exist" Oct 30 22:29:06.445963 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:06.445941 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk"] Oct 30 22:29:06.495634 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:06.495610 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-3b596750-sink-68455f6f94-mkbwk"] Oct 30 22:29:06.838688 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:06.838665 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:29:06.937005 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:06.936943 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a813c820b512db2d\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a813c820b512db2d\") pod \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\" (UID: \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\") " Oct 30 22:29:06.937005 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:06.936974 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c71afa1e-a709-4d23-9056-e20deb9dfd5e-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c71afa1e-a709-4d23-9056-e20deb9dfd5e-kube-rbac-proxy-sar-config\") pod \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\" (UID: \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\") " Oct 30 22:29:06.937191 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:06.937017 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c71afa1e-a709-4d23-9056-e20deb9dfd5e-proxy-tls\" (UniqueName: \"kubernetes.io/secret/c71afa1e-a709-4d23-9056-e20deb9dfd5e-proxy-tls\") pod \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\" (UID: \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\") " Oct 30 22:29:06.937191 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:06.937052 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c71afa1e-a709-4d23-9056-e20deb9dfd5e-kube-api-access-2jwmz\" (UniqueName: \"kubernetes.io/projected/c71afa1e-a709-4d23-9056-e20deb9dfd5e-kube-api-access-2jwmz\") pod \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\" (UID: \"c71afa1e-a709-4d23-9056-e20deb9dfd5e\") " Oct 30 22:29:06.937428 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:06.937402 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c71afa1e-a709-4d23-9056-e20deb9dfd5e-kube-rbac-proxy-sar-config" pod "c71afa1e-a709-4d23-9056-e20deb9dfd5e" (UID: "c71afa1e-a709-4d23-9056-e20deb9dfd5e"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:29:06.939714 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:06.939689 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a813c820b512db2d" pod "c71afa1e-a709-4d23-9056-e20deb9dfd5e" (UID: "c71afa1e-a709-4d23-9056-e20deb9dfd5e"). InnerVolumeSpecName "pvc-d7fb5af1-9b8f-4132-af5d-0b32ec1f000c". PluginName "kubernetes.io/csi", VolumeGIDValue "" Oct 30 22:29:06.939866 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:06.939846 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c71afa1e-a709-4d23-9056-e20deb9dfd5e-proxy-tls" pod "c71afa1e-a709-4d23-9056-e20deb9dfd5e" (UID: "c71afa1e-a709-4d23-9056-e20deb9dfd5e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:29:06.939942 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:06.939916 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c71afa1e-a709-4d23-9056-e20deb9dfd5e-kube-api-access-2jwmz" pod "c71afa1e-a709-4d23-9056-e20deb9dfd5e" (UID: "c71afa1e-a709-4d23-9056-e20deb9dfd5e"). InnerVolumeSpecName "kube-api-access-2jwmz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:29:07.037940 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.037902 4497 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c71afa1e-a709-4d23-9056-e20deb9dfd5e-proxy-tls\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:29:07.037940 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.037938 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jwmz\" (UniqueName: \"kubernetes.io/projected/c71afa1e-a709-4d23-9056-e20deb9dfd5e-kube-api-access-2jwmz\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:29:07.038182 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.037974 4497 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-d7fb5af1-9b8f-4132-af5d-0b32ec1f000c\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a813c820b512db2d\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" " Oct 30 22:29:07.038182 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.037988 4497 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c71afa1e-a709-4d23-9056-e20deb9dfd5e-kube-rbac-proxy-sar-config\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:29:07.047002 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.046985 4497 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-d7fb5af1-9b8f-4132-af5d-0b32ec1f000c" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a813c820b512db2d") on node "ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:29:07.138824 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.138790 4497 reconciler_common.go:299] "Volume detached for volume \"pvc-d7fb5af1-9b8f-4132-af5d-0b32ec1f000c\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a813c820b512db2d\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"csi-8add7cdafe4a56cee966616e86a738a97f1836260d05eadb7415e05431f4c573\"" Oct 30 22:29:07.285480 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.285417 4497 generic.go:356] "Generic (PLEG): container finished" podID="c71afa1e-a709-4d23-9056-e20deb9dfd5e" containerID="a62d5e1fb6580ded07c14adf8a98ee22e4e30384ba467ee8a878cbc8b928265a" exitCode=137 Oct 30 22:29:07.285480 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.285474 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" Oct 30 22:29:07.285627 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.285493 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" event={"ID":"c71afa1e-a709-4d23-9056-e20deb9dfd5e","Type":"ContainerDied","Data":"a62d5e1fb6580ded07c14adf8a98ee22e4e30384ba467ee8a878cbc8b928265a"} Oct 30 22:29:07.285627 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.285546 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc" event={"ID":"c71afa1e-a709-4d23-9056-e20deb9dfd5e","Type":"ContainerDied","Data":"792fdc1b7a5074a942da030d8219b6448325d2572947c42b88b401cd0f1eba46"} Oct 30 22:29:07.285627 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.285572 4497 scope.go:122] "RemoveContainer" containerID="6be65248ffa21bccd2eccd0d78223deb618f7178cf3d512d39e92841d9b017fe" Oct 30 22:29:07.294061 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.294045 4497 scope.go:122] "RemoveContainer" containerID="a62d5e1fb6580ded07c14adf8a98ee22e4e30384ba467ee8a878cbc8b928265a" Oct 30 22:29:07.301063 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.301044 4497 scope.go:122] "RemoveContainer" containerID="6be65248ffa21bccd2eccd0d78223deb618f7178cf3d512d39e92841d9b017fe" Oct 30 22:29:07.301336 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:29:07.301318 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6be65248ffa21bccd2eccd0d78223deb618f7178cf3d512d39e92841d9b017fe\": container with ID starting with 6be65248ffa21bccd2eccd0d78223deb618f7178cf3d512d39e92841d9b017fe not found: ID does not exist" containerID="6be65248ffa21bccd2eccd0d78223deb618f7178cf3d512d39e92841d9b017fe" Oct 30 22:29:07.301387 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.301343 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be65248ffa21bccd2eccd0d78223deb618f7178cf3d512d39e92841d9b017fe"} err="failed to get container status \"6be65248ffa21bccd2eccd0d78223deb618f7178cf3d512d39e92841d9b017fe\": rpc error: code = NotFound desc = could not find container \"6be65248ffa21bccd2eccd0d78223deb618f7178cf3d512d39e92841d9b017fe\": container with ID starting with 6be65248ffa21bccd2eccd0d78223deb618f7178cf3d512d39e92841d9b017fe not found: ID does not exist" Oct 30 22:29:07.301387 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.301360 4497 scope.go:122] "RemoveContainer" containerID="a62d5e1fb6580ded07c14adf8a98ee22e4e30384ba467ee8a878cbc8b928265a" Oct 30 22:29:07.301575 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:29:07.301557 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a62d5e1fb6580ded07c14adf8a98ee22e4e30384ba467ee8a878cbc8b928265a\": container with ID starting with a62d5e1fb6580ded07c14adf8a98ee22e4e30384ba467ee8a878cbc8b928265a not found: ID does not exist" containerID="a62d5e1fb6580ded07c14adf8a98ee22e4e30384ba467ee8a878cbc8b928265a" Oct 30 22:29:07.301627 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.301581 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a62d5e1fb6580ded07c14adf8a98ee22e4e30384ba467ee8a878cbc8b928265a"} err="failed to get container status \"a62d5e1fb6580ded07c14adf8a98ee22e4e30384ba467ee8a878cbc8b928265a\": rpc error: code = NotFound desc = could not find container \"a62d5e1fb6580ded07c14adf8a98ee22e4e30384ba467ee8a878cbc8b928265a\": container with ID starting with a62d5e1fb6580ded07c14adf8a98ee22e4e30384ba467ee8a878cbc8b928265a not found: ID does not exist" Oct 30 22:29:07.451887 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.451864 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc"] Oct 30 22:29:07.458883 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.458861 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-3b596750-predictor-7fc775c4bc-ghfgc"] Oct 30 22:29:07.539924 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.539873 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c71afa1e-a709-4d23-9056-e20deb9dfd5e" path="/var/lib/kubelet/pods/c71afa1e-a709-4d23-9056-e20deb9dfd5e/volumes" Oct 30 22:29:07.540212 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.540199 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fca8ced6-3dac-4509-98ca-94d87f1163de" path="/var/lib/kubelet/pods/fca8ced6-3dac-4509-98ca-94d87f1163de/volumes" Oct 30 22:29:07.657479 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:07.657451 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:08.052379 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:08.052347 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:09.652968 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.652933 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg"] Oct 30 22:29:09.653472 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.653351 4497 cpu_manager.go:414] "containerMap: removing container" podUID="c71afa1e-a709-4d23-9056-e20deb9dfd5e" containerName="kserve-container" Oct 30 22:29:09.653472 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.653369 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c71afa1e-a709-4d23-9056-e20deb9dfd5e" containerName="kserve-container" Oct 30 22:29:09.653472 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.653398 4497 cpu_manager.go:414] "containerMap: removing container" podUID="c71afa1e-a709-4d23-9056-e20deb9dfd5e" containerName="kube-rbac-proxy" Oct 30 22:29:09.653472 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.653404 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c71afa1e-a709-4d23-9056-e20deb9dfd5e" containerName="kube-rbac-proxy" Oct 30 22:29:09.653472 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.653404 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:09.653669 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.653416 4497 cpu_manager.go:414] "containerMap: removing container" podUID="fca8ced6-3dac-4509-98ca-94d87f1163de" containerName="kserve-container" Oct 30 22:29:09.653669 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.653517 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fca8ced6-3dac-4509-98ca-94d87f1163de" containerName="kserve-container" Oct 30 22:29:09.653669 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.653631 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="c71afa1e-a709-4d23-9056-e20deb9dfd5e" containerName="kube-rbac-proxy" Oct 30 22:29:09.653669 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.653645 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="fca8ced6-3dac-4509-98ca-94d87f1163de" containerName="kserve-container" Oct 30 22:29:09.653669 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.653660 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="c71afa1e-a709-4d23-9056-e20deb9dfd5e" containerName="kserve-container" Oct 30 22:29:09.658395 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.658369 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg" Oct 30 22:29:09.714411 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.714391 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"openshift-service-ca.crt\"" Oct 30 22:29:09.715129 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.715105 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg"] Oct 30 22:29:09.758883 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.758864 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgkkd\" (UniqueName: \"kubernetes.io/projected/19a5e04b-35bd-4843-82b5-6c8680700494-kube-api-access-hgkkd\") pod \"proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg\" (UID: \"19a5e04b-35bd-4843-82b5-6c8680700494\") " pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg" Oct 30 22:29:09.763157 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.763143 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"kube-root-ca.crt\"" Oct 30 22:29:09.763419 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.763407 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"default-dockercfg-s9cqw\"" Oct 30 22:29:09.860067 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.860032 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgkkd\" (UniqueName: \"kubernetes.io/projected/19a5e04b-35bd-4843-82b5-6c8680700494-kube-api-access-hgkkd\") pod \"proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg\" (UID: \"19a5e04b-35bd-4843-82b5-6c8680700494\") " pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg" Oct 30 22:29:09.922955 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.922903 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgkkd\" (UniqueName: \"kubernetes.io/projected/19a5e04b-35bd-4843-82b5-6c8680700494-kube-api-access-hgkkd\") pod \"proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg\" (UID: \"19a5e04b-35bd-4843-82b5-6c8680700494\") " pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg" Oct 30 22:29:09.928201 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.928171 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:09.970175 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:09.970154 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg" Oct 30 22:29:10.336109 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:10.336029 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg"] Oct 30 22:29:10.338929 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:29:10.338898 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a5e04b_35bd_4843_82b5_6c8680700494.slice/crio-82edd61e18093c47f75e11a672b7a0caea003f615fbaf3b1abce038a6a2b423a WatchSource:0}: Error finding container 82edd61e18093c47f75e11a672b7a0caea003f615fbaf3b1abce038a6a2b423a: Status 404 returned error can't find the container with id 82edd61e18093c47f75e11a672b7a0caea003f615fbaf3b1abce038a6a2b423a Oct 30 22:29:11.304138 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:11.304109 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg" event={"ID":"19a5e04b-35bd-4843-82b5-6c8680700494","Type":"ContainerStarted","Data":"7ad68b06601de4236485d161650de531f3dc7999fb04bd34b0b29e9bd9b57aa8"} Oct 30 22:29:11.304586 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:11.304154 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg" event={"ID":"19a5e04b-35bd-4843-82b5-6c8680700494","Type":"ContainerStarted","Data":"82edd61e18093c47f75e11a672b7a0caea003f615fbaf3b1abce038a6a2b423a"} Oct 30 22:29:11.304586 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:11.304328 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg" Oct 30 22:29:11.306530 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:11.306511 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg" Oct 30 22:29:11.420127 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:11.420088 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg" podStartSLOduration=2.420077008 podStartE2EDuration="2.420077008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:29:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:29:11.41886037 +0000 UTC m=+1246.045925921" watchObservedRunningTime="2026-10-30 22:29:11.420077008 +0000 UTC m=+1246.047142558" Oct 30 22:29:13.734279 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:13.734227 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:14.052573 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:14.052488 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:14.338317 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:14.338226 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:16.774710 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:16.774677 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:17.095027 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:17.094948 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:17.101265 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:17.101228 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw"] Oct 30 22:29:17.104558 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:17.104544 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:17.161596 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:17.161574 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"proxy-routing-8a1316e3-kube-rbac-proxy-sar-config\"" Oct 30 22:29:17.210560 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:17.210542 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"proxy-routing-8a1316e3-dockercfg-zpksn\"" Oct 30 22:29:17.210560 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:17.210544 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"proxy-routing-8a1316e3-predictor-serving-cert\"" Oct 30 22:29:17.211336 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:17.211320 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw"] Oct 30 22:29:17.211757 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:17.211732 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e73ae7be-2448-414c-b1e9-75a51ccdc63f-kube-rbac-proxy-sar-config\") pod \"proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw\" (UID: \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\") " pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:17.211870 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:17.211789 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e73ae7be-2448-414c-b1e9-75a51ccdc63f-proxy-tls\") pod \"proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw\" (UID: \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\") " pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:17.211870 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:17.211806 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56zdv\" (UniqueName: \"kubernetes.io/projected/e73ae7be-2448-414c-b1e9-75a51ccdc63f-kube-api-access-56zdv\") pod \"proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw\" (UID: \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\") " pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:17.312198 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:17.312165 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e73ae7be-2448-414c-b1e9-75a51ccdc63f-kube-rbac-proxy-sar-config\") pod \"proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw\" (UID: \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\") " pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:17.312355 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:17.312226 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e73ae7be-2448-414c-b1e9-75a51ccdc63f-proxy-tls\") pod \"proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw\" (UID: \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\") " pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:17.312355 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:17.312287 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56zdv\" (UniqueName: \"kubernetes.io/projected/e73ae7be-2448-414c-b1e9-75a51ccdc63f-kube-api-access-56zdv\") pod \"proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw\" (UID: \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\") " pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:17.312911 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:17.312893 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e73ae7be-2448-414c-b1e9-75a51ccdc63f-kube-rbac-proxy-sar-config\") pod \"proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw\" (UID: \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\") " pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:17.314795 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:17.314775 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e73ae7be-2448-414c-b1e9-75a51ccdc63f-proxy-tls\") pod \"proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw\" (UID: \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\") " pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:17.375184 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:17.375157 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56zdv\" (UniqueName: \"kubernetes.io/projected/e73ae7be-2448-414c-b1e9-75a51ccdc63f-kube-api-access-56zdv\") pod \"proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw\" (UID: \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\") " pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:17.417005 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:17.416985 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:19.295885 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:19.295851 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:19.621051 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:19.620964 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:22.926857 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:22.926818 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:23.200544 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:23.200469 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:26.968813 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:26.968781 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-ba682be2-cfe3-4665-8427-0689ac14d7a0\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c14deff475f16038\") pod \"proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw\" (UID: \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\") " pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:27.074745 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:27.074717 4497 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-ba682be2-cfe3-4665-8427-0689ac14d7a0\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c14deff475f16038\") pod \"proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw\" (UID: \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\") device path: \"\"" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:27.170322 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:27.170297 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-ba682be2-cfe3-4665-8427-0689ac14d7a0\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c14deff475f16038\") pod \"proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw\" (UID: \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\") " pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:27.170435 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:27.170422 4497 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-ba682be2-cfe3-4665-8427-0689ac14d7a0\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c14deff475f16038\") pod \"proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw\" (UID: \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\") DevicePath \"\"" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:27.223118 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:27.223067 4497 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-ba682be2-cfe3-4665-8427-0689ac14d7a0\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c14deff475f16038\") pod \"proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw\" (UID: \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\") DevicePath \"csi-9b01f0b7908d1401c52a005d1b7b29fd9a9280d8aacf7020b81e48ebc5e7ed2d\"" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:27.426642 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:27.426620 4497 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-ba682be2-cfe3-4665-8427-0689ac14d7a0\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c14deff475f16038\") pod \"proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw\" (UID: \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/b4bb5959f4d6000876c3f46e9a2d2a92191874203a9fa59d26f124fa21abd49f/globalmount\"" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:27.491687 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:27.491631 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-ba682be2-cfe3-4665-8427-0689ac14d7a0\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c14deff475f16038\") pod \"proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw\" (UID: \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\") " pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:27.670910 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:27.670886 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"proxy-routing-8a1316e3-dockercfg-zpksn\"" Oct 30 22:29:27.680103 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:27.680073 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:28.104620 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:28.104477 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw"] Oct 30 22:29:28.106842 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:29:28.106813 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode73ae7be_2448_414c_b1e9_75a51ccdc63f.slice/crio-aecf0de57ed7e930786010adae59cd550fc15432b3f1bc4d77970abec6f1ae7f WatchSource:0}: Error finding container aecf0de57ed7e930786010adae59cd550fc15432b3f1bc4d77970abec6f1ae7f: Status 404 returned error can't find the container with id aecf0de57ed7e930786010adae59cd550fc15432b3f1bc4d77970abec6f1ae7f Oct 30 22:29:28.373298 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:28.373218 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" event={"ID":"e73ae7be-2448-414c-b1e9-75a51ccdc63f","Type":"ContainerStarted","Data":"acb617772dbc343aef7f1a0739600f3d49b4df36d1eb71756624a64a6dffce55"} Oct 30 22:29:28.373454 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:28.373305 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" event={"ID":"e73ae7be-2448-414c-b1e9-75a51ccdc63f","Type":"ContainerStarted","Data":"0ba8fe7980a22ee732db4aa787d7b78145bc494c511857e14f8540bd15bd433d"} Oct 30 22:29:28.373454 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:28.373346 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:28.373454 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:28.373379 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" event={"ID":"e73ae7be-2448-414c-b1e9-75a51ccdc63f","Type":"ContainerStarted","Data":"4ff885b74a0dcc8bf203e1aa50a2e71279b4fdf21c58ba4cf8f7dc269e3f9679"} Oct 30 22:29:28.373454 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:28.373410 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" event={"ID":"e73ae7be-2448-414c-b1e9-75a51ccdc63f","Type":"ContainerStarted","Data":"aecf0de57ed7e930786010adae59cd550fc15432b3f1bc4d77970abec6f1ae7f"} Oct 30 22:29:28.373454 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:28.373442 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:28.375132 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:28.375092 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="kserve-container" probeResult="failure" output="Get \"http://10.133.0.35:8080/\": dial tcp 10.133.0.35:8080: connect: connection refused" Oct 30 22:29:28.495289 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:28.495222 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" podStartSLOduration=14.495209847 podStartE2EDuration="14.495209847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:29:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:29:28.494036449 +0000 UTC m=+1263.121101999" watchObservedRunningTime="2026-10-30 22:29:28.495209847 +0000 UTC m=+1263.122275453" Oct 30 22:29:29.377461 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:29.377429 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:29.378712 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:29.378689 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:29.379125 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:29.379110 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:29.654972 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:29:29.654894 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:29:36.389644 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:29:36.389611 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:29:59.653598 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:29:59.653561 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:30:12.706021 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:12.705947 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg"] Oct 30 22:30:12.706521 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:12.706182 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg" podUID="19a5e04b-35bd-4843-82b5-6c8680700494" containerName="kserve-container" containerID="cri-o://7ad68b06601de4236485d161650de531f3dc7999fb04bd34b0b29e9bd9b57aa8" gracePeriod=30 Oct 30 22:30:12.853587 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:12.853559 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:13.117509 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:13.117417 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:13.997633 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:13.997605 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw"] Oct 30 22:30:13.998009 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:13.997832 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="kserve-container" containerID="cri-o://4ff885b74a0dcc8bf203e1aa50a2e71279b4fdf21c58ba4cf8f7dc269e3f9679" gracePeriod=30 Oct 30 22:30:13.998009 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:13.997850 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="agent" containerID="cri-o://acb617772dbc343aef7f1a0739600f3d49b4df36d1eb71756624a64a6dffce55" gracePeriod=30 Oct 30 22:30:13.998009 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:13.997865 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="kube-rbac-proxy" containerID="cri-o://0ba8fe7980a22ee732db4aa787d7b78145bc494c511857e14f8540bd15bd433d" gracePeriod=30 Oct 30 22:30:14.195707 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:14.195676 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:14.561615 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:14.561582 4497 generic.go:356] "Generic (PLEG): container finished" podID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerID="0ba8fe7980a22ee732db4aa787d7b78145bc494c511857e14f8540bd15bd433d" exitCode=0 Oct 30 22:30:14.561769 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:14.561640 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" event={"ID":"e73ae7be-2448-414c-b1e9-75a51ccdc63f","Type":"ContainerDied","Data":"0ba8fe7980a22ee732db4aa787d7b78145bc494c511857e14f8540bd15bd433d"} Oct 30 22:30:16.385529 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:16.385495 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.35:8643/healthz\": dial tcp 10.133.0.35:8643: connect: connection refused" Oct 30 22:30:19.378036 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:19.377992 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:30:19.638338 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:19.638258 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:21.385257 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:21.385209 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.35:8643/healthz\": dial tcp 10.133.0.35:8643: connect: connection refused" Oct 30 22:30:26.386090 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:26.386050 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.35:8643/healthz\": dial tcp 10.133.0.35:8643: connect: connection refused" Oct 30 22:30:26.386503 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:26.386180 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:30:29.378125 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:29.378083 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:30:29.655981 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:30:29.655887 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:30:30.361409 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:30.361376 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:31.385528 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:31.385482 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.35:8643/healthz\": dial tcp 10.133.0.35:8643: connect: connection refused" Oct 30 22:30:36.385551 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:36.385508 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.35:8643/healthz\": dial tcp 10.133.0.35:8643: connect: connection refused" Oct 30 22:30:38.937131 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:38.937092 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:39.216774 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:39.216681 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:39.378327 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:39.378288 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:30:39.378487 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:39.378419 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:30:41.385416 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:41.385378 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.35:8643/healthz\": dial tcp 10.133.0.35:8643: connect: connection refused" Oct 30 22:30:42.881498 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:42.881476 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg" Oct 30 22:30:42.998491 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:42.998425 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/19a5e04b-35bd-4843-82b5-6c8680700494-kube-api-access-hgkkd\" (UniqueName: \"kubernetes.io/projected/19a5e04b-35bd-4843-82b5-6c8680700494-kube-api-access-hgkkd\") pod \"19a5e04b-35bd-4843-82b5-6c8680700494\" (UID: \"19a5e04b-35bd-4843-82b5-6c8680700494\") " Oct 30 22:30:43.001076 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:43.001053 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19a5e04b-35bd-4843-82b5-6c8680700494-kube-api-access-hgkkd" pod "19a5e04b-35bd-4843-82b5-6c8680700494" (UID: "19a5e04b-35bd-4843-82b5-6c8680700494"). InnerVolumeSpecName "kube-api-access-hgkkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:30:43.099067 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:43.099041 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgkkd\" (UniqueName: \"kubernetes.io/projected/19a5e04b-35bd-4843-82b5-6c8680700494-kube-api-access-hgkkd\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:30:43.668226 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:43.668190 4497 generic.go:356] "Generic (PLEG): container finished" podID="19a5e04b-35bd-4843-82b5-6c8680700494" containerID="7ad68b06601de4236485d161650de531f3dc7999fb04bd34b0b29e9bd9b57aa8" exitCode=137 Oct 30 22:30:43.668381 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:43.668262 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg" Oct 30 22:30:43.668381 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:43.668278 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg" event={"ID":"19a5e04b-35bd-4843-82b5-6c8680700494","Type":"ContainerDied","Data":"7ad68b06601de4236485d161650de531f3dc7999fb04bd34b0b29e9bd9b57aa8"} Oct 30 22:30:43.668381 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:43.668332 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg" event={"ID":"19a5e04b-35bd-4843-82b5-6c8680700494","Type":"ContainerDied","Data":"82edd61e18093c47f75e11a672b7a0caea003f615fbaf3b1abce038a6a2b423a"} Oct 30 22:30:43.668381 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:43.668353 4497 scope.go:122] "RemoveContainer" containerID="7ad68b06601de4236485d161650de531f3dc7999fb04bd34b0b29e9bd9b57aa8" Oct 30 22:30:43.677762 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:43.677745 4497 scope.go:122] "RemoveContainer" containerID="7ad68b06601de4236485d161650de531f3dc7999fb04bd34b0b29e9bd9b57aa8" Oct 30 22:30:43.678041 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:30:43.678022 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ad68b06601de4236485d161650de531f3dc7999fb04bd34b0b29e9bd9b57aa8\": container with ID starting with 7ad68b06601de4236485d161650de531f3dc7999fb04bd34b0b29e9bd9b57aa8 not found: ID does not exist" containerID="7ad68b06601de4236485d161650de531f3dc7999fb04bd34b0b29e9bd9b57aa8" Oct 30 22:30:43.678120 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:43.678048 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ad68b06601de4236485d161650de531f3dc7999fb04bd34b0b29e9bd9b57aa8"} err="failed to get container status \"7ad68b06601de4236485d161650de531f3dc7999fb04bd34b0b29e9bd9b57aa8\": rpc error: code = NotFound desc = could not find container \"7ad68b06601de4236485d161650de531f3dc7999fb04bd34b0b29e9bd9b57aa8\": container with ID starting with 7ad68b06601de4236485d161650de531f3dc7999fb04bd34b0b29e9bd9b57aa8 not found: ID does not exist" Oct 30 22:30:43.834083 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:43.834030 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg"] Oct 30 22:30:43.883794 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:43.883768 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-8a1316e3-sink-6d99f4f6bf-d8rfg"] Oct 30 22:30:44.054429 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:30:44.054376 4497 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode73ae7be_2448_414c_b1e9_75a51ccdc63f.slice/crio-4ff885b74a0dcc8bf203e1aa50a2e71279b4fdf21c58ba4cf8f7dc269e3f9679.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode73ae7be_2448_414c_b1e9_75a51ccdc63f.slice/crio-acb617772dbc343aef7f1a0739600f3d49b4df36d1eb71756624a64a6dffce55.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode73ae7be_2448_414c_b1e9_75a51ccdc63f.slice/crio-conmon-4ff885b74a0dcc8bf203e1aa50a2e71279b4fdf21c58ba4cf8f7dc269e3f9679.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode73ae7be_2448_414c_b1e9_75a51ccdc63f.slice/crio-conmon-acb617772dbc343aef7f1a0739600f3d49b4df36d1eb71756624a64a6dffce55.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a5e04b_35bd_4843_82b5_6c8680700494.slice/crio-conmon-7ad68b06601de4236485d161650de531f3dc7999fb04bd34b0b29e9bd9b57aa8.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a5e04b_35bd_4843_82b5_6c8680700494.slice/crio-82edd61e18093c47f75e11a672b7a0caea003f615fbaf3b1abce038a6a2b423a\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a5e04b_35bd_4843_82b5_6c8680700494.slice\": RecentStats: unable to find data in memory cache]" Oct 30 22:30:44.182976 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.182956 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:30:44.306625 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.306600 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e73ae7be-2448-414c-b1e9-75a51ccdc63f-kube-api-access-56zdv\" (UniqueName: \"kubernetes.io/projected/e73ae7be-2448-414c-b1e9-75a51ccdc63f-kube-api-access-56zdv\") pod \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\" (UID: \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\") " Oct 30 22:30:44.306793 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.306642 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e73ae7be-2448-414c-b1e9-75a51ccdc63f-proxy-tls\" (UniqueName: \"kubernetes.io/secret/e73ae7be-2448-414c-b1e9-75a51ccdc63f-proxy-tls\") pod \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\" (UID: \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\") " Oct 30 22:30:44.306793 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.306691 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e73ae7be-2448-414c-b1e9-75a51ccdc63f-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e73ae7be-2448-414c-b1e9-75a51ccdc63f-kube-rbac-proxy-sar-config\") pod \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\" (UID: \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\") " Oct 30 22:30:44.306793 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.306774 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c14deff475f16038\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c14deff475f16038\") pod \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\" (UID: \"e73ae7be-2448-414c-b1e9-75a51ccdc63f\") " Oct 30 22:30:44.307702 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.307677 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e73ae7be-2448-414c-b1e9-75a51ccdc63f-kube-rbac-proxy-sar-config" pod "e73ae7be-2448-414c-b1e9-75a51ccdc63f" (UID: "e73ae7be-2448-414c-b1e9-75a51ccdc63f"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:30:44.309368 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.309339 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e73ae7be-2448-414c-b1e9-75a51ccdc63f-kube-api-access-56zdv" pod "e73ae7be-2448-414c-b1e9-75a51ccdc63f" (UID: "e73ae7be-2448-414c-b1e9-75a51ccdc63f"). InnerVolumeSpecName "kube-api-access-56zdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:30:44.310207 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.310181 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0c14deff475f16038" pod "e73ae7be-2448-414c-b1e9-75a51ccdc63f" (UID: "e73ae7be-2448-414c-b1e9-75a51ccdc63f"). InnerVolumeSpecName "pvc-ba682be2-cfe3-4665-8427-0689ac14d7a0". PluginName "kubernetes.io/csi", VolumeGIDValue "" Oct 30 22:30:44.312347 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.312324 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e73ae7be-2448-414c-b1e9-75a51ccdc63f-proxy-tls" pod "e73ae7be-2448-414c-b1e9-75a51ccdc63f" (UID: "e73ae7be-2448-414c-b1e9-75a51ccdc63f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:30:44.407679 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.407654 4497 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e73ae7be-2448-414c-b1e9-75a51ccdc63f-kube-rbac-proxy-sar-config\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:30:44.407794 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.407701 4497 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-ba682be2-cfe3-4665-8427-0689ac14d7a0\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c14deff475f16038\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" " Oct 30 22:30:44.407794 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.407719 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56zdv\" (UniqueName: \"kubernetes.io/projected/e73ae7be-2448-414c-b1e9-75a51ccdc63f-kube-api-access-56zdv\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:30:44.407794 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.407733 4497 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e73ae7be-2448-414c-b1e9-75a51ccdc63f-proxy-tls\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:30:44.416162 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.416146 4497 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-ba682be2-cfe3-4665-8427-0689ac14d7a0" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0c14deff475f16038") on node "ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:30:44.508460 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.508436 4497 reconciler_common.go:299] "Volume detached for volume \"pvc-ba682be2-cfe3-4665-8427-0689ac14d7a0\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c14deff475f16038\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"csi-9b01f0b7908d1401c52a005d1b7b29fd9a9280d8aacf7020b81e48ebc5e7ed2d\"" Oct 30 22:30:44.675533 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.675466 4497 generic.go:356] "Generic (PLEG): container finished" podID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerID="acb617772dbc343aef7f1a0739600f3d49b4df36d1eb71756624a64a6dffce55" exitCode=137 Oct 30 22:30:44.675533 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.675489 4497 generic.go:356] "Generic (PLEG): container finished" podID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerID="4ff885b74a0dcc8bf203e1aa50a2e71279b4fdf21c58ba4cf8f7dc269e3f9679" exitCode=137 Oct 30 22:30:44.675533 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.675519 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" Oct 30 22:30:44.675670 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.675543 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" event={"ID":"e73ae7be-2448-414c-b1e9-75a51ccdc63f","Type":"ContainerDied","Data":"acb617772dbc343aef7f1a0739600f3d49b4df36d1eb71756624a64a6dffce55"} Oct 30 22:30:44.675670 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.675598 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" event={"ID":"e73ae7be-2448-414c-b1e9-75a51ccdc63f","Type":"ContainerDied","Data":"4ff885b74a0dcc8bf203e1aa50a2e71279b4fdf21c58ba4cf8f7dc269e3f9679"} Oct 30 22:30:44.675670 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.675623 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw" event={"ID":"e73ae7be-2448-414c-b1e9-75a51ccdc63f","Type":"ContainerDied","Data":"aecf0de57ed7e930786010adae59cd550fc15432b3f1bc4d77970abec6f1ae7f"} Oct 30 22:30:44.675670 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.675649 4497 scope.go:122] "RemoveContainer" containerID="acb617772dbc343aef7f1a0739600f3d49b4df36d1eb71756624a64a6dffce55" Oct 30 22:30:44.683940 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.683923 4497 scope.go:122] "RemoveContainer" containerID="0ba8fe7980a22ee732db4aa787d7b78145bc494c511857e14f8540bd15bd433d" Oct 30 22:30:44.691389 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.691374 4497 scope.go:122] "RemoveContainer" containerID="4ff885b74a0dcc8bf203e1aa50a2e71279b4fdf21c58ba4cf8f7dc269e3f9679" Oct 30 22:30:44.698090 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.698075 4497 scope.go:122] "RemoveContainer" containerID="acb617772dbc343aef7f1a0739600f3d49b4df36d1eb71756624a64a6dffce55" Oct 30 22:30:44.698386 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:30:44.698363 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acb617772dbc343aef7f1a0739600f3d49b4df36d1eb71756624a64a6dffce55\": container with ID starting with acb617772dbc343aef7f1a0739600f3d49b4df36d1eb71756624a64a6dffce55 not found: ID does not exist" containerID="acb617772dbc343aef7f1a0739600f3d49b4df36d1eb71756624a64a6dffce55" Oct 30 22:30:44.698477 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.698395 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acb617772dbc343aef7f1a0739600f3d49b4df36d1eb71756624a64a6dffce55"} err="failed to get container status \"acb617772dbc343aef7f1a0739600f3d49b4df36d1eb71756624a64a6dffce55\": rpc error: code = NotFound desc = could not find container \"acb617772dbc343aef7f1a0739600f3d49b4df36d1eb71756624a64a6dffce55\": container with ID starting with acb617772dbc343aef7f1a0739600f3d49b4df36d1eb71756624a64a6dffce55 not found: ID does not exist" Oct 30 22:30:44.698477 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.698419 4497 scope.go:122] "RemoveContainer" containerID="0ba8fe7980a22ee732db4aa787d7b78145bc494c511857e14f8540bd15bd433d" Oct 30 22:30:44.698690 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:30:44.698671 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ba8fe7980a22ee732db4aa787d7b78145bc494c511857e14f8540bd15bd433d\": container with ID starting with 0ba8fe7980a22ee732db4aa787d7b78145bc494c511857e14f8540bd15bd433d not found: ID does not exist" containerID="0ba8fe7980a22ee732db4aa787d7b78145bc494c511857e14f8540bd15bd433d" Oct 30 22:30:44.698755 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.698697 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ba8fe7980a22ee732db4aa787d7b78145bc494c511857e14f8540bd15bd433d"} err="failed to get container status \"0ba8fe7980a22ee732db4aa787d7b78145bc494c511857e14f8540bd15bd433d\": rpc error: code = NotFound desc = could not find container \"0ba8fe7980a22ee732db4aa787d7b78145bc494c511857e14f8540bd15bd433d\": container with ID starting with 0ba8fe7980a22ee732db4aa787d7b78145bc494c511857e14f8540bd15bd433d not found: ID does not exist" Oct 30 22:30:44.698755 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.698717 4497 scope.go:122] "RemoveContainer" containerID="4ff885b74a0dcc8bf203e1aa50a2e71279b4fdf21c58ba4cf8f7dc269e3f9679" Oct 30 22:30:44.698960 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:30:44.698940 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ff885b74a0dcc8bf203e1aa50a2e71279b4fdf21c58ba4cf8f7dc269e3f9679\": container with ID starting with 4ff885b74a0dcc8bf203e1aa50a2e71279b4fdf21c58ba4cf8f7dc269e3f9679 not found: ID does not exist" containerID="4ff885b74a0dcc8bf203e1aa50a2e71279b4fdf21c58ba4cf8f7dc269e3f9679" Oct 30 22:30:44.699003 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.698966 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ff885b74a0dcc8bf203e1aa50a2e71279b4fdf21c58ba4cf8f7dc269e3f9679"} err="failed to get container status \"4ff885b74a0dcc8bf203e1aa50a2e71279b4fdf21c58ba4cf8f7dc269e3f9679\": rpc error: code = NotFound desc = could not find container \"4ff885b74a0dcc8bf203e1aa50a2e71279b4fdf21c58ba4cf8f7dc269e3f9679\": container with ID starting with 4ff885b74a0dcc8bf203e1aa50a2e71279b4fdf21c58ba4cf8f7dc269e3f9679 not found: ID does not exist" Oct 30 22:30:44.699003 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.698989 4497 scope.go:122] "RemoveContainer" containerID="acb617772dbc343aef7f1a0739600f3d49b4df36d1eb71756624a64a6dffce55" Oct 30 22:30:44.699188 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.699172 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acb617772dbc343aef7f1a0739600f3d49b4df36d1eb71756624a64a6dffce55"} err="failed to get container status \"acb617772dbc343aef7f1a0739600f3d49b4df36d1eb71756624a64a6dffce55\": rpc error: code = NotFound desc = could not find container \"acb617772dbc343aef7f1a0739600f3d49b4df36d1eb71756624a64a6dffce55\": container with ID starting with acb617772dbc343aef7f1a0739600f3d49b4df36d1eb71756624a64a6dffce55 not found: ID does not exist" Oct 30 22:30:44.699231 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.699188 4497 scope.go:122] "RemoveContainer" containerID="0ba8fe7980a22ee732db4aa787d7b78145bc494c511857e14f8540bd15bd433d" Oct 30 22:30:44.699645 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.699629 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ba8fe7980a22ee732db4aa787d7b78145bc494c511857e14f8540bd15bd433d"} err="failed to get container status \"0ba8fe7980a22ee732db4aa787d7b78145bc494c511857e14f8540bd15bd433d\": rpc error: code = NotFound desc = could not find container \"0ba8fe7980a22ee732db4aa787d7b78145bc494c511857e14f8540bd15bd433d\": container with ID starting with 0ba8fe7980a22ee732db4aa787d7b78145bc494c511857e14f8540bd15bd433d not found: ID does not exist" Oct 30 22:30:44.699688 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.699645 4497 scope.go:122] "RemoveContainer" containerID="4ff885b74a0dcc8bf203e1aa50a2e71279b4fdf21c58ba4cf8f7dc269e3f9679" Oct 30 22:30:44.699866 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.699851 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ff885b74a0dcc8bf203e1aa50a2e71279b4fdf21c58ba4cf8f7dc269e3f9679"} err="failed to get container status \"4ff885b74a0dcc8bf203e1aa50a2e71279b4fdf21c58ba4cf8f7dc269e3f9679\": rpc error: code = NotFound desc = could not find container \"4ff885b74a0dcc8bf203e1aa50a2e71279b4fdf21c58ba4cf8f7dc269e3f9679\": container with ID starting with 4ff885b74a0dcc8bf203e1aa50a2e71279b4fdf21c58ba4cf8f7dc269e3f9679 not found: ID does not exist" Oct 30 22:30:44.845843 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.845812 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw"] Oct 30 22:30:44.857002 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:44.856978 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-8a1316e3-predictor-755fb4b8d6-r77kw"] Oct 30 22:30:45.058434 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:45.058409 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:45.336415 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:45.336336 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:45.540841 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:45.540814 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="19a5e04b-35bd-4843-82b5-6c8680700494" path="/var/lib/kubelet/pods/19a5e04b-35bd-4843-82b5-6c8680700494/volumes" Oct 30 22:30:45.541271 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:45.541255 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" path="/var/lib/kubelet/pods/e73ae7be-2448-414c-b1e9-75a51ccdc63f/volumes" Oct 30 22:30:47.002986 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.002957 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs"] Oct 30 22:30:47.003389 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.003293 4497 cpu_manager.go:414] "containerMap: removing container" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="agent" Oct 30 22:30:47.003389 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.003304 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="agent" Oct 30 22:30:47.003389 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.003318 4497 cpu_manager.go:414] "containerMap: removing container" podUID="19a5e04b-35bd-4843-82b5-6c8680700494" containerName="kserve-container" Oct 30 22:30:47.003389 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.003323 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="19a5e04b-35bd-4843-82b5-6c8680700494" containerName="kserve-container" Oct 30 22:30:47.003389 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.003331 4497 cpu_manager.go:414] "containerMap: removing container" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="kube-rbac-proxy" Oct 30 22:30:47.003389 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.003335 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="kube-rbac-proxy" Oct 30 22:30:47.003389 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.003343 4497 cpu_manager.go:414] "containerMap: removing container" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="kserve-container" Oct 30 22:30:47.003389 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.003347 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="kserve-container" Oct 30 22:30:47.003389 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.003391 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="19a5e04b-35bd-4843-82b5-6c8680700494" containerName="kserve-container" Oct 30 22:30:47.003687 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.003397 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="kube-rbac-proxy" Oct 30 22:30:47.003687 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.003404 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="kserve-container" Oct 30 22:30:47.003687 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.003413 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="e73ae7be-2448-414c-b1e9-75a51ccdc63f" containerName="agent" Oct 30 22:30:47.007870 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.007847 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs" Oct 30 22:30:47.078034 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.078010 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs"] Oct 30 22:30:47.080410 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.080385 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:47.126140 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.126119 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"default-dockercfg-s9cqw\"" Oct 30 22:30:47.126302 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.126287 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"kube-root-ca.crt\"" Oct 30 22:30:47.126302 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.126291 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"openshift-service-ca.crt\"" Oct 30 22:30:47.128565 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.128549 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clnb8\" (UniqueName: \"kubernetes.io/projected/40a88cf0-e5eb-4237-92df-eb2a0a3d2c69-kube-api-access-clnb8\") pod \"proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs\" (UID: \"40a88cf0-e5eb-4237-92df-eb2a0a3d2c69\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs" Oct 30 22:30:47.229643 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.229617 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clnb8\" (UniqueName: \"kubernetes.io/projected/40a88cf0-e5eb-4237-92df-eb2a0a3d2c69-kube-api-access-clnb8\") pod \"proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs\" (UID: \"40a88cf0-e5eb-4237-92df-eb2a0a3d2c69\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs" Oct 30 22:30:47.293132 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.293077 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clnb8\" (UniqueName: \"kubernetes.io/projected/40a88cf0-e5eb-4237-92df-eb2a0a3d2c69-kube-api-access-clnb8\") pod \"proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs\" (UID: \"40a88cf0-e5eb-4237-92df-eb2a0a3d2c69\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs" Oct 30 22:30:47.321518 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.321496 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs" Oct 30 22:30:47.408075 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.408038 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:47.690988 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:47.690965 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs"] Oct 30 22:30:47.692798 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:30:47.692767 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a88cf0_e5eb_4237_92df_eb2a0a3d2c69.slice/crio-a19792f644d2c0e8ca4947808eb65c6f9e5e98796f08f7e35156e3ede0ada045 WatchSource:0}: Error finding container a19792f644d2c0e8ca4947808eb65c6f9e5e98796f08f7e35156e3ede0ada045: Status 404 returned error can't find the container with id a19792f644d2c0e8ca4947808eb65c6f9e5e98796f08f7e35156e3ede0ada045 Oct 30 22:30:48.694448 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:48.694413 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs" event={"ID":"40a88cf0-e5eb-4237-92df-eb2a0a3d2c69","Type":"ContainerStarted","Data":"9cc2a93160ee8f7e9dad2e73159e15f455be2554030601b5ab2131f4814e5a54"} Oct 30 22:30:48.694898 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:48.694462 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs" event={"ID":"40a88cf0-e5eb-4237-92df-eb2a0a3d2c69","Type":"ContainerStarted","Data":"a19792f644d2c0e8ca4947808eb65c6f9e5e98796f08f7e35156e3ede0ada045"} Oct 30 22:30:48.694898 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:48.694569 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs" Oct 30 22:30:48.696680 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:48.696663 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs" Oct 30 22:30:48.810682 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:48.810636 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs" podStartSLOduration=2.81062352 podStartE2EDuration="2.81062352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:30:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:30:48.809592055 +0000 UTC m=+1343.436657630" watchObservedRunningTime="2026-10-30 22:30:48.81062352 +0000 UTC m=+1343.437689070" Oct 30 22:30:50.827548 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:50.827464 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:51.102923 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:51.102834 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:51.369856 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:51.369774 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:53.428090 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:53.428054 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:53.706572 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:53.706498 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:53.988737 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:53.988668 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk"] Oct 30 22:30:53.991926 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:53.991911 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:30:54.045652 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:54.045628 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"proxy-routing-b7ac4fc4-kube-rbac-proxy-sar-config\"" Oct 30 22:30:54.078840 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:54.078809 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-kube-rbac-proxy-sar-config\") pod \"proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk\" (UID: \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:30:54.078956 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:54.078856 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-proxy-tls\") pod \"proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk\" (UID: \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:30:54.078956 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:54.078875 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmwkv\" (UniqueName: \"kubernetes.io/projected/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-kube-api-access-rmwkv\") pod \"proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk\" (UID: \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:30:54.094507 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:54.094486 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"proxy-routing-b7ac4fc4-predictor-serving-cert\"" Oct 30 22:30:54.094507 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:54.094490 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"proxy-routing-b7ac4fc4-dockercfg-tshzk\"" Oct 30 22:30:54.095673 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:54.095657 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk"] Oct 30 22:30:54.179265 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:54.179225 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-proxy-tls\") pod \"proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk\" (UID: \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:30:54.179379 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:54.179267 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmwkv\" (UniqueName: \"kubernetes.io/projected/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-kube-api-access-rmwkv\") pod \"proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk\" (UID: \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:30:54.179379 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:54.179304 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-kube-rbac-proxy-sar-config\") pod \"proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk\" (UID: \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:30:54.179855 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:54.179838 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-kube-rbac-proxy-sar-config\") pod \"proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk\" (UID: \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:30:54.181788 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:54.181769 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-proxy-tls\") pod \"proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk\" (UID: \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:30:54.196255 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:54.196216 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:54.245218 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:54.245165 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmwkv\" (UniqueName: \"kubernetes.io/projected/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-kube-api-access-rmwkv\") pod \"proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk\" (UID: \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:30:59.517528 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:59.517495 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-e09cedc8-4c08-457d-a2cd-9481061f6de6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-052f7194572ff86df\") pod \"proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk\" (UID: \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:30:59.623701 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:59.623668 4497 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-e09cedc8-4c08-457d-a2cd-9481061f6de6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-052f7194572ff86df\") pod \"proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk\" (UID: \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\") device path: \"\"" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:30:59.654742 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:30:59.654705 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:30:59.719335 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:59.719310 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-e09cedc8-4c08-457d-a2cd-9481061f6de6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-052f7194572ff86df\") pod \"proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk\" (UID: \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:30:59.719445 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:59.719427 4497 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-e09cedc8-4c08-457d-a2cd-9481061f6de6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-052f7194572ff86df\") pod \"proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk\" (UID: \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\") DevicePath \"\"" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:30:59.772309 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:59.772254 4497 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-e09cedc8-4c08-457d-a2cd-9481061f6de6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-052f7194572ff86df\") pod \"proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk\" (UID: \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\") DevicePath \"csi-7b85945e6dd253010f0f4274d5d2d9d3ef63543c814a3c0d0ecb2fe5eadf156c\"" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:30:59.980102 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:30:59.980075 4497 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-e09cedc8-4c08-457d-a2cd-9481061f6de6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-052f7194572ff86df\") pod \"proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk\" (UID: \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/90e7cd1674f6470ab3c1290fc96cdffcbd73d98525a99c0cb46316f4a93f1681/globalmount\"" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:31:00.044313 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:00.044225 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-e09cedc8-4c08-457d-a2cd-9481061f6de6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-052f7194572ff86df\") pod \"proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk\" (UID: \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:31:00.305189 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:00.305104 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:31:00.353885 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:00.353857 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:31:00.728893 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:00.728869 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk"] Oct 30 22:31:00.731225 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:31:00.731198 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f2082ef_05d4_4ce1_a57c_975fafa5cbc7.slice/crio-39a8197e21c70c85588a436f522a0938c0d02aa799a1d190ce6c76f0dbb4c83d WatchSource:0}: Error finding container 39a8197e21c70c85588a436f522a0938c0d02aa799a1d190ce6c76f0dbb4c83d: Status 404 returned error can't find the container with id 39a8197e21c70c85588a436f522a0938c0d02aa799a1d190ce6c76f0dbb4c83d Oct 30 22:31:00.743483 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:00.743452 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" event={"ID":"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7","Type":"ContainerStarted","Data":"39a8197e21c70c85588a436f522a0938c0d02aa799a1d190ce6c76f0dbb4c83d"} Oct 30 22:31:00.749898 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:00.749876 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:31:01.749509 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:01.749462 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" event={"ID":"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7","Type":"ContainerStarted","Data":"eb10f4319c665ef5744a06d84b3507208d9b71876bd5d3edb82eed029fb51c3d"} Oct 30 22:31:01.749958 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:01.749531 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" event={"ID":"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7","Type":"ContainerStarted","Data":"b20a3d3126bd7aff4b5450b76a606897d8e7bfb1bcca24054e0b0cc0ec866bd7"} Oct 30 22:31:01.749958 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:01.749567 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:31:01.929660 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:01.929608 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" podStartSLOduration=11.929594031 podStartE2EDuration="11.929594031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:30:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:31:01.879917083 +0000 UTC m=+1356.506982637" watchObservedRunningTime="2026-10-30 22:31:01.929594031 +0000 UTC m=+1356.556659581" Oct 30 22:31:02.754088 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:02.754041 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:31:02.756228 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:02.756197 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:31:09.767120 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:09.767094 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:31:11.074077 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:11.074033 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:31:20.060205 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:20.060164 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:31:20.827225 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:20.827190 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h"] Oct 30 22:31:20.830525 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:20.830502 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:31:20.872927 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:20.872902 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwg7f\" (UniqueName: \"kubernetes.io/projected/1aab3a42-f4a2-416b-ae46-804bb728ac90-kube-api-access-zwg7f\") pod \"proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h\" (UID: \"1aab3a42-f4a2-416b-ae46-804bb728ac90\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:31:20.873028 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:20.872942 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1aab3a42-f4a2-416b-ae46-804bb728ac90-kube-rbac-proxy-sar-config\") pod \"proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h\" (UID: \"1aab3a42-f4a2-416b-ae46-804bb728ac90\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:31:20.873075 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:20.873025 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1aab3a42-f4a2-416b-ae46-804bb728ac90-proxy-tls\") pod \"proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h\" (UID: \"1aab3a42-f4a2-416b-ae46-804bb728ac90\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:31:20.937210 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:20.937188 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h"] Oct 30 22:31:20.973786 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:20.973767 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1aab3a42-f4a2-416b-ae46-804bb728ac90-kube-rbac-proxy-sar-config\") pod \"proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h\" (UID: \"1aab3a42-f4a2-416b-ae46-804bb728ac90\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:31:20.973911 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:20.973810 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1aab3a42-f4a2-416b-ae46-804bb728ac90-proxy-tls\") pod \"proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h\" (UID: \"1aab3a42-f4a2-416b-ae46-804bb728ac90\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:31:20.973911 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:20.973832 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwg7f\" (UniqueName: \"kubernetes.io/projected/1aab3a42-f4a2-416b-ae46-804bb728ac90-kube-api-access-zwg7f\") pod \"proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h\" (UID: \"1aab3a42-f4a2-416b-ae46-804bb728ac90\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:31:20.974470 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:20.974433 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1aab3a42-f4a2-416b-ae46-804bb728ac90-kube-rbac-proxy-sar-config\") pod \"proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h\" (UID: \"1aab3a42-f4a2-416b-ae46-804bb728ac90\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:31:20.976278 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:20.976263 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1aab3a42-f4a2-416b-ae46-804bb728ac90-proxy-tls\") pod \"proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h\" (UID: \"1aab3a42-f4a2-416b-ae46-804bb728ac90\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:31:21.036441 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:21.036421 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwg7f\" (UniqueName: \"kubernetes.io/projected/1aab3a42-f4a2-416b-ae46-804bb728ac90-kube-api-access-zwg7f\") pod \"proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h\" (UID: \"1aab3a42-f4a2-416b-ae46-804bb728ac90\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:31:21.074323 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:21.074303 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-e09cedc8-4c08-457d-a2cd-9481061f6de6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-052f7194572ff86df\") pod \"proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h\" (UID: \"1aab3a42-f4a2-416b-ae46-804bb728ac90\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:31:21.074671 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:21.074457 4497 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-e09cedc8-4c08-457d-a2cd-9481061f6de6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-052f7194572ff86df\") pod \"proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h\" (UID: \"1aab3a42-f4a2-416b-ae46-804bb728ac90\") DevicePath \"csi-7b85945e6dd253010f0f4274d5d2d9d3ef63543c814a3c0d0ecb2fe5eadf156c\"" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:31:21.131698 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:21.131675 4497 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-e09cedc8-4c08-457d-a2cd-9481061f6de6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-052f7194572ff86df\") pod \"proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h\" (UID: \"1aab3a42-f4a2-416b-ae46-804bb728ac90\") DevicePath \"csi-7b85945e6dd253010f0f4274d5d2d9d3ef63543c814a3c0d0ecb2fe5eadf156c\"" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:31:21.196889 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:21.194660 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-e09cedc8-4c08-457d-a2cd-9481061f6de6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-052f7194572ff86df\") pod \"proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h\" (UID: \"1aab3a42-f4a2-416b-ae46-804bb728ac90\") " pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:31:21.445223 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:21.445162 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:31:21.864524 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:21.864503 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h"] Oct 30 22:31:21.866675 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:31:21.866648 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aab3a42_f4a2_416b_ae46_804bb728ac90.slice/crio-a1e82829bb8fe9625c0e09339d2ab19b524f2d24554cafb10634867d35ba735d WatchSource:0}: Error finding container a1e82829bb8fe9625c0e09339d2ab19b524f2d24554cafb10634867d35ba735d: Status 404 returned error can't find the container with id a1e82829bb8fe9625c0e09339d2ab19b524f2d24554cafb10634867d35ba735d Oct 30 22:31:22.843430 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:22.843398 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" event={"ID":"1aab3a42-f4a2-416b-ae46-804bb728ac90","Type":"ContainerStarted","Data":"8644bf0a1ff9a6bcb64b9cc62fbc1522c72b6e2278b841a8c40ccffcb8a6ff14"} Oct 30 22:31:22.843826 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:22.843454 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" event={"ID":"1aab3a42-f4a2-416b-ae46-804bb728ac90","Type":"ContainerStarted","Data":"5f755b771fd91257a23a25475f707e7b65256bf49706ad20f40942d578330e90"} Oct 30 22:31:22.843826 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:22.843473 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" event={"ID":"1aab3a42-f4a2-416b-ae46-804bb728ac90","Type":"ContainerStarted","Data":"a1e82829bb8fe9625c0e09339d2ab19b524f2d24554cafb10634867d35ba735d"} Oct 30 22:31:22.843826 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:22.843522 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:31:22.996817 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:22.996769 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" podStartSLOduration=2.996756988 podStartE2EDuration="2.996756988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:31:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:31:22.969729313 +0000 UTC m=+1377.596794863" watchObservedRunningTime="2026-10-30 22:31:22.996756988 +0000 UTC m=+1377.623822538" Oct 30 22:31:23.847501 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:23.847464 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:31:23.850542 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:23.850512 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:31:29.654770 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:31:29.654730 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:31:29.700490 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:29.700458 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:31:30.861604 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:30.861575 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:31:31.082397 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:31.082367 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk"] Oct 30 22:31:31.082618 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:31.082594 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" podUID="7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" containerName="kserve-container" containerID="cri-o://b20a3d3126bd7aff4b5450b76a606897d8e7bfb1bcca24054e0b0cc0ec866bd7" gracePeriod=30 Oct 30 22:31:31.082759 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:31.082712 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" podUID="7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" containerName="kube-rbac-proxy" containerID="cri-o://eb10f4319c665ef5744a06d84b3507208d9b71876bd5d3edb82eed029fb51c3d" gracePeriod=30 Oct 30 22:31:31.882858 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:31.882827 4497 generic.go:356] "Generic (PLEG): container finished" podID="7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" containerID="eb10f4319c665ef5744a06d84b3507208d9b71876bd5d3edb82eed029fb51c3d" exitCode=0 Oct 30 22:31:31.883279 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:31.882890 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" event={"ID":"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7","Type":"ContainerDied","Data":"eb10f4319c665ef5744a06d84b3507208d9b71876bd5d3edb82eed029fb51c3d"} Oct 30 22:31:34.661790 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:34.661758 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:31:34.762990 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:34.762954 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" podUID="7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.37:8643/healthz\": dial tcp 10.133.0.37:8643: connect: connection refused" Oct 30 22:31:35.008267 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:35.008167 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:31:38.448880 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:38.448788 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:31:39.763221 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:39.763181 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" podUID="7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.37:8643/healthz\": dial tcp 10.133.0.37:8643: connect: connection refused" Oct 30 22:31:44.763175 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:44.763135 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" podUID="7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.37:8643/healthz\": dial tcp 10.133.0.37:8643: connect: connection refused" Oct 30 22:31:44.763591 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:44.763307 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:31:49.475869 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:49.475829 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:31:49.762957 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:49.762862 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" podUID="7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.37:8643/healthz\": dial tcp 10.133.0.37:8643: connect: connection refused" Oct 30 22:31:49.779207 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:49.779180 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:31:53.447167 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:53.447120 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:31:53.762825 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:53.762738 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:31:54.762396 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:54.762359 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" podUID="7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.37:8643/healthz\": dial tcp 10.133.0.37:8643: connect: connection refused" Oct 30 22:31:59.653364 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:31:59.653329 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:31:59.762943 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:31:59.762910 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" podUID="7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.37:8643/healthz\": dial tcp 10.133.0.37:8643: connect: connection refused" Oct 30 22:32:01.270563 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:01.270543 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:32:01.382788 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:01.382769 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-052f7194572ff86df\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-052f7194572ff86df\") pod \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\" (UID: \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\") " Oct 30 22:32:01.382915 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:01.382863 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-kube-rbac-proxy-sar-config\") pod \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\" (UID: \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\") " Oct 30 22:32:01.382915 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:01.382889 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-kube-api-access-rmwkv\" (UniqueName: \"kubernetes.io/projected/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-kube-api-access-rmwkv\") pod \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\" (UID: \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\") " Oct 30 22:32:01.382915 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:01.382908 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-proxy-tls\" (UniqueName: \"kubernetes.io/secret/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-proxy-tls\") pod \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\" (UID: \"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7\") " Oct 30 22:32:01.383315 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:01.383275 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-kube-rbac-proxy-sar-config" pod "7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" (UID: "7f2082ef-05d4-4ce1-a57c-975fafa5cbc7"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:32:01.385126 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:01.385098 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-proxy-tls" pod "7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" (UID: "7f2082ef-05d4-4ce1-a57c-975fafa5cbc7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:32:01.385215 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:01.385164 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-kube-api-access-rmwkv" pod "7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" (UID: "7f2082ef-05d4-4ce1-a57c-975fafa5cbc7"). InnerVolumeSpecName "kube-api-access-rmwkv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:32:01.385537 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:01.385522 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-052f7194572ff86df" pod "7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" (UID: "7f2082ef-05d4-4ce1-a57c-975fafa5cbc7"). InnerVolumeSpecName "pvc-e09cedc8-4c08-457d-a2cd-9481061f6de6". PluginName "kubernetes.io/csi", VolumeGIDValue "" Oct 30 22:32:01.483351 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:01.483322 4497 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-kube-rbac-proxy-sar-config\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:32:01.483351 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:01.483349 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmwkv\" (UniqueName: \"kubernetes.io/projected/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-kube-api-access-rmwkv\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:32:01.483510 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:01.483359 4497 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7-proxy-tls\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:32:02.007059 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:02.007022 4497 generic.go:356] "Generic (PLEG): container finished" podID="7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" containerID="b20a3d3126bd7aff4b5450b76a606897d8e7bfb1bcca24054e0b0cc0ec866bd7" exitCode=137 Oct 30 22:32:02.007287 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:02.007086 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" Oct 30 22:32:02.007287 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:02.007114 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" event={"ID":"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7","Type":"ContainerDied","Data":"b20a3d3126bd7aff4b5450b76a606897d8e7bfb1bcca24054e0b0cc0ec866bd7"} Oct 30 22:32:02.007287 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:02.007196 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk" event={"ID":"7f2082ef-05d4-4ce1-a57c-975fafa5cbc7","Type":"ContainerDied","Data":"39a8197e21c70c85588a436f522a0938c0d02aa799a1d190ce6c76f0dbb4c83d"} Oct 30 22:32:02.007287 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:02.007233 4497 scope.go:122] "RemoveContainer" containerID="eb10f4319c665ef5744a06d84b3507208d9b71876bd5d3edb82eed029fb51c3d" Oct 30 22:32:02.022717 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:02.022693 4497 scope.go:122] "RemoveContainer" containerID="b20a3d3126bd7aff4b5450b76a606897d8e7bfb1bcca24054e0b0cc0ec866bd7" Oct 30 22:32:02.030729 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:02.030709 4497 scope.go:122] "RemoveContainer" containerID="eb10f4319c665ef5744a06d84b3507208d9b71876bd5d3edb82eed029fb51c3d" Oct 30 22:32:02.031016 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:32:02.030998 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb10f4319c665ef5744a06d84b3507208d9b71876bd5d3edb82eed029fb51c3d\": container with ID starting with eb10f4319c665ef5744a06d84b3507208d9b71876bd5d3edb82eed029fb51c3d not found: ID does not exist" containerID="eb10f4319c665ef5744a06d84b3507208d9b71876bd5d3edb82eed029fb51c3d" Oct 30 22:32:02.031083 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:02.031023 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb10f4319c665ef5744a06d84b3507208d9b71876bd5d3edb82eed029fb51c3d"} err="failed to get container status \"eb10f4319c665ef5744a06d84b3507208d9b71876bd5d3edb82eed029fb51c3d\": rpc error: code = NotFound desc = could not find container \"eb10f4319c665ef5744a06d84b3507208d9b71876bd5d3edb82eed029fb51c3d\": container with ID starting with eb10f4319c665ef5744a06d84b3507208d9b71876bd5d3edb82eed029fb51c3d not found: ID does not exist" Oct 30 22:32:02.031083 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:02.031042 4497 scope.go:122] "RemoveContainer" containerID="b20a3d3126bd7aff4b5450b76a606897d8e7bfb1bcca24054e0b0cc0ec866bd7" Oct 30 22:32:02.031322 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:32:02.031303 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b20a3d3126bd7aff4b5450b76a606897d8e7bfb1bcca24054e0b0cc0ec866bd7\": container with ID starting with b20a3d3126bd7aff4b5450b76a606897d8e7bfb1bcca24054e0b0cc0ec866bd7 not found: ID does not exist" containerID="b20a3d3126bd7aff4b5450b76a606897d8e7bfb1bcca24054e0b0cc0ec866bd7" Oct 30 22:32:02.031384 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:02.031326 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b20a3d3126bd7aff4b5450b76a606897d8e7bfb1bcca24054e0b0cc0ec866bd7"} err="failed to get container status \"b20a3d3126bd7aff4b5450b76a606897d8e7bfb1bcca24054e0b0cc0ec866bd7\": rpc error: code = NotFound desc = could not find container \"b20a3d3126bd7aff4b5450b76a606897d8e7bfb1bcca24054e0b0cc0ec866bd7\": container with ID starting with b20a3d3126bd7aff4b5450b76a606897d8e7bfb1bcca24054e0b0cc0ec866bd7 not found: ID does not exist" Oct 30 22:32:02.224926 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:02.224898 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk"] Oct 30 22:32:02.275197 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:02.275140 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5fcc94cfbd-4z4bk"] Oct 30 22:32:03.539544 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:03.539514 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" path="/var/lib/kubelet/pods/7f2082ef-05d4-4ce1-a57c-975fafa5cbc7/volumes" Oct 30 22:32:03.800871 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:03.800795 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs"] Oct 30 22:32:03.801044 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:03.801019 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs" podUID="40a88cf0-e5eb-4237-92df-eb2a0a3d2c69" containerName="kserve-container" containerID="cri-o://9cc2a93160ee8f7e9dad2e73159e15f455be2554030601b5ab2131f4814e5a54" gracePeriod=30 Oct 30 22:32:03.929870 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:03.929830 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:04.205056 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:04.205024 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:04.868450 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:04.868416 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h"] Oct 30 22:32:04.868908 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:04.868632 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" podUID="1aab3a42-f4a2-416b-ae46-804bb728ac90" containerName="kserve-container" containerID="cri-o://5f755b771fd91257a23a25475f707e7b65256bf49706ad20f40942d578330e90" gracePeriod=30 Oct 30 22:32:04.868908 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:04.868672 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" podUID="1aab3a42-f4a2-416b-ae46-804bb728ac90" containerName="kube-rbac-proxy" containerID="cri-o://8644bf0a1ff9a6bcb64b9cc62fbc1522c72b6e2278b841a8c40ccffcb8a6ff14" gracePeriod=30 Oct 30 22:32:04.996254 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:04.996209 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:05.024471 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:05.024444 4497 generic.go:356] "Generic (PLEG): container finished" podID="1aab3a42-f4a2-416b-ae46-804bb728ac90" containerID="8644bf0a1ff9a6bcb64b9cc62fbc1522c72b6e2278b841a8c40ccffcb8a6ff14" exitCode=0 Oct 30 22:32:05.024600 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:05.024511 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" event={"ID":"1aab3a42-f4a2-416b-ae46-804bb728ac90","Type":"ContainerDied","Data":"8644bf0a1ff9a6bcb64b9cc62fbc1522c72b6e2278b841a8c40ccffcb8a6ff14"} Oct 30 22:32:05.857089 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:05.857052 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" podUID="1aab3a42-f4a2-416b-ae46-804bb728ac90" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.38:8643/healthz\": dial tcp 10.133.0.38:8643: connect: connection refused" Oct 30 22:32:10.856672 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:10.856630 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" podUID="1aab3a42-f4a2-416b-ae46-804bb728ac90" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.38:8643/healthz\": dial tcp 10.133.0.38:8643: connect: connection refused" Oct 30 22:32:15.856725 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:15.856684 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" podUID="1aab3a42-f4a2-416b-ae46-804bb728ac90" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.38:8643/healthz\": dial tcp 10.133.0.38:8643: connect: connection refused" Oct 30 22:32:15.857146 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:15.856801 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:32:20.345104 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:20.345073 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:20.616999 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:20.616909 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:20.856831 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:20.856788 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" podUID="1aab3a42-f4a2-416b-ae46-804bb728ac90" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.38:8643/healthz\": dial tcp 10.133.0.38:8643: connect: connection refused" Oct 30 22:32:25.857430 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:25.857393 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" podUID="1aab3a42-f4a2-416b-ae46-804bb728ac90" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.38:8643/healthz\": dial tcp 10.133.0.38:8643: connect: connection refused" Oct 30 22:32:29.655573 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:32:29.655532 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:32:30.857163 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:30.857117 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" podUID="1aab3a42-f4a2-416b-ae46-804bb728ac90" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.38:8643/healthz\": dial tcp 10.133.0.38:8643: connect: connection refused" Oct 30 22:32:33.983451 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:33.983428 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs" Oct 30 22:32:34.100829 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:34.100771 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/40a88cf0-e5eb-4237-92df-eb2a0a3d2c69-kube-api-access-clnb8\" (UniqueName: \"kubernetes.io/projected/40a88cf0-e5eb-4237-92df-eb2a0a3d2c69-kube-api-access-clnb8\") pod \"40a88cf0-e5eb-4237-92df-eb2a0a3d2c69\" (UID: \"40a88cf0-e5eb-4237-92df-eb2a0a3d2c69\") " Oct 30 22:32:34.103361 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:34.103303 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40a88cf0-e5eb-4237-92df-eb2a0a3d2c69-kube-api-access-clnb8" pod "40a88cf0-e5eb-4237-92df-eb2a0a3d2c69" (UID: "40a88cf0-e5eb-4237-92df-eb2a0a3d2c69"). InnerVolumeSpecName "kube-api-access-clnb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:32:34.144841 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:34.144816 4497 generic.go:356] "Generic (PLEG): container finished" podID="40a88cf0-e5eb-4237-92df-eb2a0a3d2c69" containerID="9cc2a93160ee8f7e9dad2e73159e15f455be2554030601b5ab2131f4814e5a54" exitCode=137 Oct 30 22:32:34.144948 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:34.144857 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs" Oct 30 22:32:34.144948 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:34.144861 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs" event={"ID":"40a88cf0-e5eb-4237-92df-eb2a0a3d2c69","Type":"ContainerDied","Data":"9cc2a93160ee8f7e9dad2e73159e15f455be2554030601b5ab2131f4814e5a54"} Oct 30 22:32:34.144948 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:34.144907 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs" event={"ID":"40a88cf0-e5eb-4237-92df-eb2a0a3d2c69","Type":"ContainerDied","Data":"a19792f644d2c0e8ca4947808eb65c6f9e5e98796f08f7e35156e3ede0ada045"} Oct 30 22:32:34.144948 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:34.144928 4497 scope.go:122] "RemoveContainer" containerID="9cc2a93160ee8f7e9dad2e73159e15f455be2554030601b5ab2131f4814e5a54" Oct 30 22:32:34.153138 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:34.153124 4497 scope.go:122] "RemoveContainer" containerID="9cc2a93160ee8f7e9dad2e73159e15f455be2554030601b5ab2131f4814e5a54" Oct 30 22:32:34.153408 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:32:34.153390 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cc2a93160ee8f7e9dad2e73159e15f455be2554030601b5ab2131f4814e5a54\": container with ID starting with 9cc2a93160ee8f7e9dad2e73159e15f455be2554030601b5ab2131f4814e5a54 not found: ID does not exist" containerID="9cc2a93160ee8f7e9dad2e73159e15f455be2554030601b5ab2131f4814e5a54" Oct 30 22:32:34.153456 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:34.153416 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cc2a93160ee8f7e9dad2e73159e15f455be2554030601b5ab2131f4814e5a54"} err="failed to get container status \"9cc2a93160ee8f7e9dad2e73159e15f455be2554030601b5ab2131f4814e5a54\": rpc error: code = NotFound desc = could not find container \"9cc2a93160ee8f7e9dad2e73159e15f455be2554030601b5ab2131f4814e5a54\": container with ID starting with 9cc2a93160ee8f7e9dad2e73159e15f455be2554030601b5ab2131f4814e5a54 not found: ID does not exist" Oct 30 22:32:34.202064 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:34.202043 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clnb8\" (UniqueName: \"kubernetes.io/projected/40a88cf0-e5eb-4237-92df-eb2a0a3d2c69-kube-api-access-clnb8\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:32:34.310476 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:34.310453 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs"] Oct 30 22:32:34.315920 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:34.315901 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-sink-7ffd5449c9-8b7hs"] Oct 30 22:32:35.049267 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.049231 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:32:35.108810 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.108784 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-052f7194572ff86df\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-052f7194572ff86df\") pod \"1aab3a42-f4a2-416b-ae46-804bb728ac90\" (UID: \"1aab3a42-f4a2-416b-ae46-804bb728ac90\") " Oct 30 22:32:35.108959 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.108824 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1aab3a42-f4a2-416b-ae46-804bb728ac90-kube-api-access-zwg7f\" (UniqueName: \"kubernetes.io/projected/1aab3a42-f4a2-416b-ae46-804bb728ac90-kube-api-access-zwg7f\") pod \"1aab3a42-f4a2-416b-ae46-804bb728ac90\" (UID: \"1aab3a42-f4a2-416b-ae46-804bb728ac90\") " Oct 30 22:32:35.108959 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.108896 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1aab3a42-f4a2-416b-ae46-804bb728ac90-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1aab3a42-f4a2-416b-ae46-804bb728ac90-kube-rbac-proxy-sar-config\") pod \"1aab3a42-f4a2-416b-ae46-804bb728ac90\" (UID: \"1aab3a42-f4a2-416b-ae46-804bb728ac90\") " Oct 30 22:32:35.108959 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.108933 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1aab3a42-f4a2-416b-ae46-804bb728ac90-proxy-tls\" (UniqueName: \"kubernetes.io/secret/1aab3a42-f4a2-416b-ae46-804bb728ac90-proxy-tls\") pod \"1aab3a42-f4a2-416b-ae46-804bb728ac90\" (UID: \"1aab3a42-f4a2-416b-ae46-804bb728ac90\") " Oct 30 22:32:35.109338 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.109308 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aab3a42-f4a2-416b-ae46-804bb728ac90-kube-rbac-proxy-sar-config" pod "1aab3a42-f4a2-416b-ae46-804bb728ac90" (UID: "1aab3a42-f4a2-416b-ae46-804bb728ac90"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:32:35.111220 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.111192 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aab3a42-f4a2-416b-ae46-804bb728ac90-proxy-tls" pod "1aab3a42-f4a2-416b-ae46-804bb728ac90" (UID: "1aab3a42-f4a2-416b-ae46-804bb728ac90"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:32:35.111346 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.111286 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aab3a42-f4a2-416b-ae46-804bb728ac90-kube-api-access-zwg7f" pod "1aab3a42-f4a2-416b-ae46-804bb728ac90" (UID: "1aab3a42-f4a2-416b-ae46-804bb728ac90"). InnerVolumeSpecName "kube-api-access-zwg7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:32:35.111735 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.111718 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-052f7194572ff86df" pod "1aab3a42-f4a2-416b-ae46-804bb728ac90" (UID: "1aab3a42-f4a2-416b-ae46-804bb728ac90"). InnerVolumeSpecName "pvc-e09cedc8-4c08-457d-a2cd-9481061f6de6". PluginName "kubernetes.io/csi", VolumeGIDValue "" Oct 30 22:32:35.151664 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.151631 4497 generic.go:356] "Generic (PLEG): container finished" podID="1aab3a42-f4a2-416b-ae46-804bb728ac90" containerID="5f755b771fd91257a23a25475f707e7b65256bf49706ad20f40942d578330e90" exitCode=137 Oct 30 22:32:35.151794 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.151681 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" Oct 30 22:32:35.151794 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.151696 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" event={"ID":"1aab3a42-f4a2-416b-ae46-804bb728ac90","Type":"ContainerDied","Data":"5f755b771fd91257a23a25475f707e7b65256bf49706ad20f40942d578330e90"} Oct 30 22:32:35.151794 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.151757 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h" event={"ID":"1aab3a42-f4a2-416b-ae46-804bb728ac90","Type":"ContainerDied","Data":"a1e82829bb8fe9625c0e09339d2ab19b524f2d24554cafb10634867d35ba735d"} Oct 30 22:32:35.151794 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.151782 4497 scope.go:122] "RemoveContainer" containerID="8644bf0a1ff9a6bcb64b9cc62fbc1522c72b6e2278b841a8c40ccffcb8a6ff14" Oct 30 22:32:35.160038 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.160018 4497 scope.go:122] "RemoveContainer" containerID="5f755b771fd91257a23a25475f707e7b65256bf49706ad20f40942d578330e90" Oct 30 22:32:35.167161 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.167145 4497 scope.go:122] "RemoveContainer" containerID="8644bf0a1ff9a6bcb64b9cc62fbc1522c72b6e2278b841a8c40ccffcb8a6ff14" Oct 30 22:32:35.167454 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:32:35.167431 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8644bf0a1ff9a6bcb64b9cc62fbc1522c72b6e2278b841a8c40ccffcb8a6ff14\": container with ID starting with 8644bf0a1ff9a6bcb64b9cc62fbc1522c72b6e2278b841a8c40ccffcb8a6ff14 not found: ID does not exist" containerID="8644bf0a1ff9a6bcb64b9cc62fbc1522c72b6e2278b841a8c40ccffcb8a6ff14" Oct 30 22:32:35.167527 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.167468 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8644bf0a1ff9a6bcb64b9cc62fbc1522c72b6e2278b841a8c40ccffcb8a6ff14"} err="failed to get container status \"8644bf0a1ff9a6bcb64b9cc62fbc1522c72b6e2278b841a8c40ccffcb8a6ff14\": rpc error: code = NotFound desc = could not find container \"8644bf0a1ff9a6bcb64b9cc62fbc1522c72b6e2278b841a8c40ccffcb8a6ff14\": container with ID starting with 8644bf0a1ff9a6bcb64b9cc62fbc1522c72b6e2278b841a8c40ccffcb8a6ff14 not found: ID does not exist" Oct 30 22:32:35.167527 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.167495 4497 scope.go:122] "RemoveContainer" containerID="5f755b771fd91257a23a25475f707e7b65256bf49706ad20f40942d578330e90" Oct 30 22:32:35.167742 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:32:35.167718 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f755b771fd91257a23a25475f707e7b65256bf49706ad20f40942d578330e90\": container with ID starting with 5f755b771fd91257a23a25475f707e7b65256bf49706ad20f40942d578330e90 not found: ID does not exist" containerID="5f755b771fd91257a23a25475f707e7b65256bf49706ad20f40942d578330e90" Oct 30 22:32:35.167790 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.167750 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f755b771fd91257a23a25475f707e7b65256bf49706ad20f40942d578330e90"} err="failed to get container status \"5f755b771fd91257a23a25475f707e7b65256bf49706ad20f40942d578330e90\": rpc error: code = NotFound desc = could not find container \"5f755b771fd91257a23a25475f707e7b65256bf49706ad20f40942d578330e90\": container with ID starting with 5f755b771fd91257a23a25475f707e7b65256bf49706ad20f40942d578330e90 not found: ID does not exist" Oct 30 22:32:35.209628 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.209602 4497 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-e09cedc8-4c08-457d-a2cd-9481061f6de6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-052f7194572ff86df\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" " Oct 30 22:32:35.209628 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.209627 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwg7f\" (UniqueName: \"kubernetes.io/projected/1aab3a42-f4a2-416b-ae46-804bb728ac90-kube-api-access-zwg7f\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:32:35.209813 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.209638 4497 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1aab3a42-f4a2-416b-ae46-804bb728ac90-kube-rbac-proxy-sar-config\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:32:35.209813 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.209648 4497 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1aab3a42-f4a2-416b-ae46-804bb728ac90-proxy-tls\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:32:35.219008 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.218988 4497 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-e09cedc8-4c08-457d-a2cd-9481061f6de6" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-052f7194572ff86df") on node "ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:32:35.310730 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.310702 4497 reconciler_common.go:299] "Volume detached for volume \"pvc-e09cedc8-4c08-457d-a2cd-9481061f6de6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-052f7194572ff86df\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"csi-7b85945e6dd253010f0f4274d5d2d9d3ef63543c814a3c0d0ecb2fe5eadf156c\"" Oct 30 22:32:35.333140 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.333109 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h"] Oct 30 22:32:35.338888 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.338866 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-b7ac4fc4-predictor-5ccf877998-lr87h"] Oct 30 22:32:35.539885 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.539815 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1aab3a42-f4a2-416b-ae46-804bb728ac90" path="/var/lib/kubelet/pods/1aab3a42-f4a2-416b-ae46-804bb728ac90/volumes" Oct 30 22:32:35.540164 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.540152 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="40a88cf0-e5eb-4237-92df-eb2a0a3d2c69" path="/var/lib/kubelet/pods/40a88cf0-e5eb-4237-92df-eb2a0a3d2c69/volumes" Oct 30 22:32:35.547451 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.547415 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:35.821157 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:35.821080 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:36.007586 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.007557 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p"] Oct 30 22:32:36.007857 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.007845 4497 cpu_manager.go:414] "containerMap: removing container" podUID="40a88cf0-e5eb-4237-92df-eb2a0a3d2c69" containerName="kserve-container" Oct 30 22:32:36.007903 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.007859 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="40a88cf0-e5eb-4237-92df-eb2a0a3d2c69" containerName="kserve-container" Oct 30 22:32:36.007903 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.007871 4497 cpu_manager.go:414] "containerMap: removing container" podUID="7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" containerName="kube-rbac-proxy" Oct 30 22:32:36.007903 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.007876 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" containerName="kube-rbac-proxy" Oct 30 22:32:36.007903 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.007886 4497 cpu_manager.go:414] "containerMap: removing container" podUID="1aab3a42-f4a2-416b-ae46-804bb728ac90" containerName="kube-rbac-proxy" Oct 30 22:32:36.007903 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.007891 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1aab3a42-f4a2-416b-ae46-804bb728ac90" containerName="kube-rbac-proxy" Oct 30 22:32:36.007903 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.007900 4497 cpu_manager.go:414] "containerMap: removing container" podUID="1aab3a42-f4a2-416b-ae46-804bb728ac90" containerName="kserve-container" Oct 30 22:32:36.007903 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.007904 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1aab3a42-f4a2-416b-ae46-804bb728ac90" containerName="kserve-container" Oct 30 22:32:36.008094 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.007919 4497 cpu_manager.go:414] "containerMap: removing container" podUID="7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" containerName="kserve-container" Oct 30 22:32:36.008094 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.007923 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" containerName="kserve-container" Oct 30 22:32:36.008094 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.007967 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" containerName="kserve-container" Oct 30 22:32:36.008094 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.007975 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="40a88cf0-e5eb-4237-92df-eb2a0a3d2c69" containerName="kserve-container" Oct 30 22:32:36.008094 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.007981 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="7f2082ef-05d4-4ce1-a57c-975fafa5cbc7" containerName="kube-rbac-proxy" Oct 30 22:32:36.008094 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.007986 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="1aab3a42-f4a2-416b-ae46-804bb728ac90" containerName="kube-rbac-proxy" Oct 30 22:32:36.008094 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.007992 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="1aab3a42-f4a2-416b-ae46-804bb728ac90" containerName="kserve-container" Oct 30 22:32:36.012495 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.012474 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p" Oct 30 22:32:36.013676 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.013652 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw4n4\" (UniqueName: \"kubernetes.io/projected/9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7-kube-api-access-nw4n4\") pod \"proxy-routing-fee82af6-sink-796874dd78-4xj4p\" (UID: \"9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p" Oct 30 22:32:36.069080 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.069054 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"openshift-service-ca.crt\"" Oct 30 22:32:36.069534 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.069093 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"default-dockercfg-s9cqw\"" Oct 30 22:32:36.069708 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.069685 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p"] Oct 30 22:32:36.095336 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.095258 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:36.114270 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.114229 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw4n4\" (UniqueName: \"kubernetes.io/projected/9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7-kube-api-access-nw4n4\") pod \"proxy-routing-fee82af6-sink-796874dd78-4xj4p\" (UID: \"9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p" Oct 30 22:32:36.117899 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.117884 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"kube-root-ca.crt\"" Oct 30 22:32:36.176987 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.176958 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw4n4\" (UniqueName: \"kubernetes.io/projected/9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7-kube-api-access-nw4n4\") pod \"proxy-routing-fee82af6-sink-796874dd78-4xj4p\" (UID: \"9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p" Oct 30 22:32:36.324480 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.324441 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p" Oct 30 22:32:36.391473 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.391443 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:36.696397 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:36.696355 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p"] Oct 30 22:32:36.699514 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:32:36.699474 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee3fb5f_a06b_4f17_b2df_9eaf2bc58bf7.slice/crio-de3074b926061d51530a28ffeb6cf6dc66ae8526018a79617449fefed8c6cc46 WatchSource:0}: Error finding container de3074b926061d51530a28ffeb6cf6dc66ae8526018a79617449fefed8c6cc46: Status 404 returned error can't find the container with id de3074b926061d51530a28ffeb6cf6dc66ae8526018a79617449fefed8c6cc46 Oct 30 22:32:37.167159 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:37.167118 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p" event={"ID":"9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7","Type":"ContainerStarted","Data":"9d643f14e24506176537b3362c96820922aabc65ec2c169de6ebc2f7c2cbcdea"} Oct 30 22:32:37.167636 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:37.167178 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p" event={"ID":"9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7","Type":"ContainerStarted","Data":"de3074b926061d51530a28ffeb6cf6dc66ae8526018a79617449fefed8c6cc46"} Oct 30 22:32:37.167636 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:37.167202 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p" Oct 30 22:32:37.169666 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:37.169646 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p" Oct 30 22:32:37.297558 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:37.297504 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p" podStartSLOduration=2.29748578 podStartE2EDuration="2.29748578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:32:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:32:37.296872209 +0000 UTC m=+1451.923937759" watchObservedRunningTime="2026-10-30 22:32:37.29748578 +0000 UTC m=+1451.924551330" Oct 30 22:32:39.698493 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:39.698437 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:39.993843 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:39.993750 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:40.275724 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:40.275646 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:40.582806 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:40.582723 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:42.784919 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:42.784891 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:43.104408 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:43.104333 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z"] Oct 30 22:32:43.107663 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:43.107627 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:43.107842 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:43.107824 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:43.159212 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:43.159187 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9xc4\" (UniqueName: \"kubernetes.io/projected/1e89234e-ae6c-435a-8f91-949845e4d3c1-kube-api-access-l9xc4\") pod \"proxy-routing-fee82af6-predictor-55b9c49854-mj88z\" (UID: \"1e89234e-ae6c-435a-8f91-949845e4d3c1\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:43.159362 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:43.159254 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1e89234e-ae6c-435a-8f91-949845e4d3c1-kube-rbac-proxy-sar-config\") pod \"proxy-routing-fee82af6-predictor-55b9c49854-mj88z\" (UID: \"1e89234e-ae6c-435a-8f91-949845e4d3c1\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:43.159403 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:43.159376 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1e89234e-ae6c-435a-8f91-949845e4d3c1-proxy-tls\") pod \"proxy-routing-fee82af6-predictor-55b9c49854-mj88z\" (UID: \"1e89234e-ae6c-435a-8f91-949845e4d3c1\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:43.210672 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:43.210639 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"proxy-routing-fee82af6-dockercfg-xfrcp\"" Oct 30 22:32:43.210672 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:43.210650 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"proxy-routing-fee82af6-kube-rbac-proxy-sar-config\"" Oct 30 22:32:43.210874 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:43.210695 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"proxy-routing-fee82af6-predictor-serving-cert\"" Oct 30 22:32:43.212117 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:43.212101 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z"] Oct 30 22:32:43.260255 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:43.260204 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9xc4\" (UniqueName: \"kubernetes.io/projected/1e89234e-ae6c-435a-8f91-949845e4d3c1-kube-api-access-l9xc4\") pod \"proxy-routing-fee82af6-predictor-55b9c49854-mj88z\" (UID: \"1e89234e-ae6c-435a-8f91-949845e4d3c1\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:43.260420 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:43.260300 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1e89234e-ae6c-435a-8f91-949845e4d3c1-kube-rbac-proxy-sar-config\") pod \"proxy-routing-fee82af6-predictor-55b9c49854-mj88z\" (UID: \"1e89234e-ae6c-435a-8f91-949845e4d3c1\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:43.260420 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:43.260356 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1e89234e-ae6c-435a-8f91-949845e4d3c1-proxy-tls\") pod \"proxy-routing-fee82af6-predictor-55b9c49854-mj88z\" (UID: \"1e89234e-ae6c-435a-8f91-949845e4d3c1\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:43.260946 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:43.260926 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1e89234e-ae6c-435a-8f91-949845e4d3c1-kube-rbac-proxy-sar-config\") pod \"proxy-routing-fee82af6-predictor-55b9c49854-mj88z\" (UID: \"1e89234e-ae6c-435a-8f91-949845e4d3c1\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:43.262932 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:43.262910 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1e89234e-ae6c-435a-8f91-949845e4d3c1-proxy-tls\") pod \"proxy-routing-fee82af6-predictor-55b9c49854-mj88z\" (UID: \"1e89234e-ae6c-435a-8f91-949845e4d3c1\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:43.323222 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:43.323189 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9xc4\" (UniqueName: \"kubernetes.io/projected/1e89234e-ae6c-435a-8f91-949845e4d3c1-kube-api-access-l9xc4\") pod \"proxy-routing-fee82af6-predictor-55b9c49854-mj88z\" (UID: \"1e89234e-ae6c-435a-8f91-949845e4d3c1\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:43.404040 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:43.404004 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:50.771346 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:50.771265 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:51.087799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:51.087713 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:51.726999 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:51.726960 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b75702ab-7503-48bc-9a90-a65b0e03c365\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\") pod \"proxy-routing-fee82af6-predictor-55b9c49854-mj88z\" (UID: \"1e89234e-ae6c-435a-8f91-949845e4d3c1\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:51.832765 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:51.832734 4497 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b75702ab-7503-48bc-9a90-a65b0e03c365\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\") pod \"proxy-routing-fee82af6-predictor-55b9c49854-mj88z\" (UID: \"1e89234e-ae6c-435a-8f91-949845e4d3c1\") device path: \"\"" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:51.928174 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:51.928141 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b75702ab-7503-48bc-9a90-a65b0e03c365\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\") pod \"proxy-routing-fee82af6-predictor-55b9c49854-mj88z\" (UID: \"1e89234e-ae6c-435a-8f91-949845e4d3c1\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:51.928322 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:51.928263 4497 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b75702ab-7503-48bc-9a90-a65b0e03c365\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\") pod \"proxy-routing-fee82af6-predictor-55b9c49854-mj88z\" (UID: \"1e89234e-ae6c-435a-8f91-949845e4d3c1\") DevicePath \"\"" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:51.981591 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:51.981508 4497 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b75702ab-7503-48bc-9a90-a65b0e03c365\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\") pod \"proxy-routing-fee82af6-predictor-55b9c49854-mj88z\" (UID: \"1e89234e-ae6c-435a-8f91-949845e4d3c1\") DevicePath \"csi-6b76a1e92dbe033b04a84c3848d37de2767f19ba9e254ffa2e04e62e70e70483\"" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:52.185426 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:52.185394 4497 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b75702ab-7503-48bc-9a90-a65b0e03c365\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\") pod \"proxy-routing-fee82af6-predictor-55b9c49854-mj88z\" (UID: \"1e89234e-ae6c-435a-8f91-949845e4d3c1\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/b83e7504996080c3b3ea8f36e17e8ac7509881fc42fe7837629d9e07e368fe40/globalmount\"" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:52.249549 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:52.249478 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b75702ab-7503-48bc-9a90-a65b0e03c365\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\") pod \"proxy-routing-fee82af6-predictor-55b9c49854-mj88z\" (UID: \"1e89234e-ae6c-435a-8f91-949845e4d3c1\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:52.423663 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:52.423633 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:52.847309 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:52.847276 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z"] Oct 30 22:32:52.884637 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:32:52.884611 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e89234e_ae6c_435a_8f91_949845e4d3c1.slice/crio-c7d2fe6f5142a0e7fd6e401b1a2bbe0c81b84b8111f1692ec28816b52892a39b WatchSource:0}: Error finding container c7d2fe6f5142a0e7fd6e401b1a2bbe0c81b84b8111f1692ec28816b52892a39b: Status 404 returned error can't find the container with id c7d2fe6f5142a0e7fd6e401b1a2bbe0c81b84b8111f1692ec28816b52892a39b Oct 30 22:32:53.233184 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:53.233151 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" event={"ID":"1e89234e-ae6c-435a-8f91-949845e4d3c1","Type":"ContainerStarted","Data":"b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a"} Oct 30 22:32:53.233393 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:53.233210 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" event={"ID":"1e89234e-ae6c-435a-8f91-949845e4d3c1","Type":"ContainerStarted","Data":"45b702427fd69c08e31684abf770aa1a2e08a7177c3a1ce411677948529b3d39"} Oct 30 22:32:53.233393 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:53.233349 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:53.233532 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:53.233420 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:53.233532 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:53.233456 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" event={"ID":"1e89234e-ae6c-435a-8f91-949845e4d3c1","Type":"ContainerStarted","Data":"5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516"} Oct 30 22:32:53.233532 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:53.233499 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" event={"ID":"1e89234e-ae6c-435a-8f91-949845e4d3c1","Type":"ContainerStarted","Data":"c7d2fe6f5142a0e7fd6e401b1a2bbe0c81b84b8111f1692ec28816b52892a39b"} Oct 30 22:32:53.233645 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:53.233538 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:53.235913 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:53.235895 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:53.236345 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:53.236328 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:32:53.354258 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:32:53.354195 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" podStartSLOduration=13.354180493 podStartE2EDuration="13.354180493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:32:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:32:53.353376144 +0000 UTC m=+1467.980441706" watchObservedRunningTime="2026-10-30 22:32:53.354180493 +0000 UTC m=+1467.981246043" Oct 30 22:32:59.654073 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:32:59.654040 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:33:00.245926 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:00.245899 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:33:09.101595 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:09.101505 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d"] Oct 30 22:33:09.106849 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:09.106819 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:09.156254 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:09.156205 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3522144d-8aab-4321-85a7-49c888db8ffe-proxy-tls\") pod \"proxy-routing-fee82af6-predictor-5cf598885b-qhs9d\" (UID: \"3522144d-8aab-4321-85a7-49c888db8ffe\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:09.156415 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:09.156275 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j96rf\" (UniqueName: \"kubernetes.io/projected/3522144d-8aab-4321-85a7-49c888db8ffe-kube-api-access-j96rf\") pod \"proxy-routing-fee82af6-predictor-5cf598885b-qhs9d\" (UID: \"3522144d-8aab-4321-85a7-49c888db8ffe\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:09.156415 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:09.156367 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3522144d-8aab-4321-85a7-49c888db8ffe-kube-rbac-proxy-sar-config\") pod \"proxy-routing-fee82af6-predictor-5cf598885b-qhs9d\" (UID: \"3522144d-8aab-4321-85a7-49c888db8ffe\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:09.206746 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:09.206715 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d"] Oct 30 22:33:09.257228 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:09.257194 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3522144d-8aab-4321-85a7-49c888db8ffe-kube-rbac-proxy-sar-config\") pod \"proxy-routing-fee82af6-predictor-5cf598885b-qhs9d\" (UID: \"3522144d-8aab-4321-85a7-49c888db8ffe\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:09.257411 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:09.257270 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3522144d-8aab-4321-85a7-49c888db8ffe-proxy-tls\") pod \"proxy-routing-fee82af6-predictor-5cf598885b-qhs9d\" (UID: \"3522144d-8aab-4321-85a7-49c888db8ffe\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:09.257411 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:09.257309 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j96rf\" (UniqueName: \"kubernetes.io/projected/3522144d-8aab-4321-85a7-49c888db8ffe-kube-api-access-j96rf\") pod \"proxy-routing-fee82af6-predictor-5cf598885b-qhs9d\" (UID: \"3522144d-8aab-4321-85a7-49c888db8ffe\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:09.257906 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:09.257883 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3522144d-8aab-4321-85a7-49c888db8ffe-kube-rbac-proxy-sar-config\") pod \"proxy-routing-fee82af6-predictor-5cf598885b-qhs9d\" (UID: \"3522144d-8aab-4321-85a7-49c888db8ffe\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:09.259781 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:09.259766 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3522144d-8aab-4321-85a7-49c888db8ffe-proxy-tls\") pod \"proxy-routing-fee82af6-predictor-5cf598885b-qhs9d\" (UID: \"3522144d-8aab-4321-85a7-49c888db8ffe\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:09.320521 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:09.320490 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j96rf\" (UniqueName: \"kubernetes.io/projected/3522144d-8aab-4321-85a7-49c888db8ffe-kube-api-access-j96rf\") pod \"proxy-routing-fee82af6-predictor-5cf598885b-qhs9d\" (UID: \"3522144d-8aab-4321-85a7-49c888db8ffe\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:09.357784 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:09.357700 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b75702ab-7503-48bc-9a90-a65b0e03c365\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\") pod \"proxy-routing-fee82af6-predictor-5cf598885b-qhs9d\" (UID: \"3522144d-8aab-4321-85a7-49c888db8ffe\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:09.357933 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:09.357813 4497 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b75702ab-7503-48bc-9a90-a65b0e03c365\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\") pod \"proxy-routing-fee82af6-predictor-5cf598885b-qhs9d\" (UID: \"3522144d-8aab-4321-85a7-49c888db8ffe\") DevicePath \"csi-6b76a1e92dbe033b04a84c3848d37de2767f19ba9e254ffa2e04e62e70e70483\"" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:09.410486 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:09.410452 4497 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b75702ab-7503-48bc-9a90-a65b0e03c365\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\") pod \"proxy-routing-fee82af6-predictor-5cf598885b-qhs9d\" (UID: \"3522144d-8aab-4321-85a7-49c888db8ffe\") DevicePath \"csi-6b76a1e92dbe033b04a84c3848d37de2767f19ba9e254ffa2e04e62e70e70483\"" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:09.471719 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:09.471692 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b75702ab-7503-48bc-9a90-a65b0e03c365\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\") pod \"proxy-routing-fee82af6-predictor-5cf598885b-qhs9d\" (UID: \"3522144d-8aab-4321-85a7-49c888db8ffe\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:09.723426 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:09.723390 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:10.145964 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:10.145936 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d"] Oct 30 22:33:10.148310 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:33:10.148282 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3522144d_8aab_4321_85a7_49c888db8ffe.slice/crio-efccc37f6bd7a533a8f2a3a16e5608ddda7d695fa946ee685357ad8a55bdd47c WatchSource:0}: Error finding container efccc37f6bd7a533a8f2a3a16e5608ddda7d695fa946ee685357ad8a55bdd47c: Status 404 returned error can't find the container with id efccc37f6bd7a533a8f2a3a16e5608ddda7d695fa946ee685357ad8a55bdd47c Oct 30 22:33:10.304378 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:10.304355 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" event={"ID":"3522144d-8aab-4321-85a7-49c888db8ffe","Type":"ContainerStarted","Data":"16831f062d1567098422e05c192d4e31fb21c5e603c891f25fe70da0d67d2522"} Oct 30 22:33:10.304513 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:10.304421 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" event={"ID":"3522144d-8aab-4321-85a7-49c888db8ffe","Type":"ContainerStarted","Data":"aa83fec829446a3874aeae82c692cff29cd86d00782b102b7daf6c9b30f3732c"} Oct 30 22:33:10.304513 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:10.304458 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" event={"ID":"3522144d-8aab-4321-85a7-49c888db8ffe","Type":"ContainerStarted","Data":"efccc37f6bd7a533a8f2a3a16e5608ddda7d695fa946ee685357ad8a55bdd47c"} Oct 30 22:33:11.310586 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:11.310551 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" event={"ID":"3522144d-8aab-4321-85a7-49c888db8ffe","Type":"ContainerStarted","Data":"69776932ee48393aed02fb32e515c695536cc3a9a71330803ac15caed8de4acd"} Oct 30 22:33:11.310978 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:11.310660 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:11.530799 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:11.530747 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" podStartSLOduration=2.530732713 podStartE2EDuration="2.530732713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:33:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:33:11.480437732 +0000 UTC m=+1486.107503276" watchObservedRunningTime="2026-10-30 22:33:11.530732713 +0000 UTC m=+1486.157798263" Oct 30 22:33:12.314148 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:12.314117 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:12.314587 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:12.314186 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:12.316638 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:12.316616 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:12.317088 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:12.317071 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:19.325639 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:19.325607 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:33:19.548957 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:19.548927 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z"] Oct 30 22:33:19.549205 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:19.549182 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="agent" containerID="cri-o://b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a" gracePeriod=30 Oct 30 22:33:19.549313 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:19.549217 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="kube-rbac-proxy" containerID="cri-o://45b702427fd69c08e31684abf770aa1a2e08a7177c3a1ce411677948529b3d39" gracePeriod=30 Oct 30 22:33:19.549313 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:19.549162 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="kserve-container" containerID="cri-o://5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516" gracePeriod=30 Oct 30 22:33:20.241878 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:20.241834 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.40:8643/healthz\": dial tcp 10.133.0.40:8643: connect: connection refused" Oct 30 22:33:20.351847 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:20.351816 4497 generic.go:356] "Generic (PLEG): container finished" podID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerID="45b702427fd69c08e31684abf770aa1a2e08a7177c3a1ce411677948529b3d39" exitCode=0 Oct 30 22:33:20.352224 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:20.351884 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" event={"ID":"1e89234e-ae6c-435a-8f91-949845e4d3c1","Type":"ContainerDied","Data":"45b702427fd69c08e31684abf770aa1a2e08a7177c3a1ce411677948529b3d39"} Oct 30 22:33:20.699332 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:20.699297 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:23.234453 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:23.234401 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:33:25.241653 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:25.241609 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.40:8643/healthz\": dial tcp 10.133.0.40:8643: connect: connection refused" Oct 30 22:33:29.655477 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:33:29.655437 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:33:30.241829 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:30.241781 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.40:8643/healthz\": dial tcp 10.133.0.40:8643: connect: connection refused" Oct 30 22:33:30.242010 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:30.241935 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:33:33.234317 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:33.234272 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:33:35.241878 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:35.241839 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.40:8643/healthz\": dial tcp 10.133.0.40:8643: connect: connection refused" Oct 30 22:33:40.241752 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:40.241700 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.40:8643/healthz\": dial tcp 10.133.0.40:8643: connect: connection refused" Oct 30 22:33:43.234525 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:43.234481 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:33:43.234988 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:43.234621 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:33:45.241438 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:45.241398 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.40:8643/healthz\": dial tcp 10.133.0.40:8643: connect: connection refused" Oct 30 22:33:49.617623 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:33:49.617586 4497 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e89234e_ae6c_435a_8f91_949845e4d3c1.slice/crio-conmon-5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e89234e_ae6c_435a_8f91_949845e4d3c1.slice/crio-c7d2fe6f5142a0e7fd6e401b1a2bbe0c81b84b8111f1692ec28816b52892a39b\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e89234e_ae6c_435a_8f91_949845e4d3c1.slice/crio-conmon-b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e89234e_ae6c_435a_8f91_949845e4d3c1.slice/crio-5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516.scope\": RecentStats: unable to find data in memory cache]" Oct 30 22:33:49.618017 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:33:49.617718 4497 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e89234e_ae6c_435a_8f91_949845e4d3c1.slice/crio-b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e89234e_ae6c_435a_8f91_949845e4d3c1.slice/crio-5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e89234e_ae6c_435a_8f91_949845e4d3c1.slice/crio-conmon-5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e89234e_ae6c_435a_8f91_949845e4d3c1.slice/crio-conmon-b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a.scope\": RecentStats: unable to find data in memory cache]" Oct 30 22:33:49.753005 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:49.752981 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:33:49.882797 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:49.882776 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1e89234e-ae6c-435a-8f91-949845e4d3c1-proxy-tls\" (UniqueName: \"kubernetes.io/secret/1e89234e-ae6c-435a-8f91-949845e4d3c1-proxy-tls\") pod \"1e89234e-ae6c-435a-8f91-949845e4d3c1\" (UID: \"1e89234e-ae6c-435a-8f91-949845e4d3c1\") " Oct 30 22:33:49.882951 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:49.882878 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\") pod \"1e89234e-ae6c-435a-8f91-949845e4d3c1\" (UID: \"1e89234e-ae6c-435a-8f91-949845e4d3c1\") " Oct 30 22:33:49.882951 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:49.882924 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1e89234e-ae6c-435a-8f91-949845e4d3c1-kube-api-access-l9xc4\" (UniqueName: \"kubernetes.io/projected/1e89234e-ae6c-435a-8f91-949845e4d3c1-kube-api-access-l9xc4\") pod \"1e89234e-ae6c-435a-8f91-949845e4d3c1\" (UID: \"1e89234e-ae6c-435a-8f91-949845e4d3c1\") " Oct 30 22:33:49.883046 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:49.883006 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1e89234e-ae6c-435a-8f91-949845e4d3c1-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1e89234e-ae6c-435a-8f91-949845e4d3c1-kube-rbac-proxy-sar-config\") pod \"1e89234e-ae6c-435a-8f91-949845e4d3c1\" (UID: \"1e89234e-ae6c-435a-8f91-949845e4d3c1\") " Oct 30 22:33:49.883416 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:49.883387 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e89234e-ae6c-435a-8f91-949845e4d3c1-kube-rbac-proxy-sar-config" pod "1e89234e-ae6c-435a-8f91-949845e4d3c1" (UID: "1e89234e-ae6c-435a-8f91-949845e4d3c1"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:33:49.885082 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:49.885060 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e89234e-ae6c-435a-8f91-949845e4d3c1-proxy-tls" pod "1e89234e-ae6c-435a-8f91-949845e4d3c1" (UID: "1e89234e-ae6c-435a-8f91-949845e4d3c1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:33:49.885200 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:49.885170 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e89234e-ae6c-435a-8f91-949845e4d3c1-kube-api-access-l9xc4" pod "1e89234e-ae6c-435a-8f91-949845e4d3c1" (UID: "1e89234e-ae6c-435a-8f91-949845e4d3c1"). InnerVolumeSpecName "kube-api-access-l9xc4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:33:49.885800 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:49.885781 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00" pod "1e89234e-ae6c-435a-8f91-949845e4d3c1" (UID: "1e89234e-ae6c-435a-8f91-949845e4d3c1"). InnerVolumeSpecName "pvc-b75702ab-7503-48bc-9a90-a65b0e03c365". PluginName "kubernetes.io/csi", VolumeGIDValue "" Oct 30 22:33:49.983822 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:49.983793 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9xc4\" (UniqueName: \"kubernetes.io/projected/1e89234e-ae6c-435a-8f91-949845e4d3c1-kube-api-access-l9xc4\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:33:49.983822 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:49.983818 4497 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1e89234e-ae6c-435a-8f91-949845e4d3c1-kube-rbac-proxy-sar-config\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:33:49.983822 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:49.983828 4497 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1e89234e-ae6c-435a-8f91-949845e4d3c1-proxy-tls\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:33:50.470188 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.470153 4497 generic.go:356] "Generic (PLEG): container finished" podID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerID="b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a" exitCode=0 Oct 30 22:33:50.470188 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.470179 4497 generic.go:356] "Generic (PLEG): container finished" podID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerID="5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516" exitCode=137 Oct 30 22:33:50.470582 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.470220 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" Oct 30 22:33:50.470582 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.470252 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" event={"ID":"1e89234e-ae6c-435a-8f91-949845e4d3c1","Type":"ContainerDied","Data":"b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a"} Oct 30 22:33:50.470582 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.470348 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" event={"ID":"1e89234e-ae6c-435a-8f91-949845e4d3c1","Type":"ContainerDied","Data":"5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516"} Oct 30 22:33:50.470582 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.470372 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z" event={"ID":"1e89234e-ae6c-435a-8f91-949845e4d3c1","Type":"ContainerDied","Data":"c7d2fe6f5142a0e7fd6e401b1a2bbe0c81b84b8111f1692ec28816b52892a39b"} Oct 30 22:33:50.470582 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.470399 4497 scope.go:122] "RemoveContainer" containerID="b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a" Oct 30 22:33:50.479076 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.479059 4497 scope.go:122] "RemoveContainer" containerID="45b702427fd69c08e31684abf770aa1a2e08a7177c3a1ce411677948529b3d39" Oct 30 22:33:50.486519 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.486503 4497 scope.go:122] "RemoveContainer" containerID="5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516" Oct 30 22:33:50.493773 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.493755 4497 scope.go:122] "RemoveContainer" containerID="b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a" Oct 30 22:33:50.494055 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:33:50.494026 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a\": container with ID starting with b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a not found: ID does not exist" containerID="b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a" Oct 30 22:33:50.494101 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.494068 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a"} err="failed to get container status \"b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a\": rpc error: code = NotFound desc = could not find container \"b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a\": container with ID starting with b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a not found: ID does not exist" Oct 30 22:33:50.494101 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.494090 4497 scope.go:122] "RemoveContainer" containerID="45b702427fd69c08e31684abf770aa1a2e08a7177c3a1ce411677948529b3d39" Oct 30 22:33:50.494362 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:33:50.494341 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45b702427fd69c08e31684abf770aa1a2e08a7177c3a1ce411677948529b3d39\": container with ID starting with 45b702427fd69c08e31684abf770aa1a2e08a7177c3a1ce411677948529b3d39 not found: ID does not exist" containerID="45b702427fd69c08e31684abf770aa1a2e08a7177c3a1ce411677948529b3d39" Oct 30 22:33:50.494439 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.494372 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b702427fd69c08e31684abf770aa1a2e08a7177c3a1ce411677948529b3d39"} err="failed to get container status \"45b702427fd69c08e31684abf770aa1a2e08a7177c3a1ce411677948529b3d39\": rpc error: code = NotFound desc = could not find container \"45b702427fd69c08e31684abf770aa1a2e08a7177c3a1ce411677948529b3d39\": container with ID starting with 45b702427fd69c08e31684abf770aa1a2e08a7177c3a1ce411677948529b3d39 not found: ID does not exist" Oct 30 22:33:50.494439 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.494394 4497 scope.go:122] "RemoveContainer" containerID="5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516" Oct 30 22:33:50.494659 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:33:50.494641 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516\": container with ID starting with 5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516 not found: ID does not exist" containerID="5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516" Oct 30 22:33:50.494703 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.494664 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516"} err="failed to get container status \"5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516\": rpc error: code = NotFound desc = could not find container \"5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516\": container with ID starting with 5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516 not found: ID does not exist" Oct 30 22:33:50.494703 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.494677 4497 scope.go:122] "RemoveContainer" containerID="b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a" Oct 30 22:33:50.494887 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.494872 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a"} err="failed to get container status \"b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a\": rpc error: code = NotFound desc = could not find container \"b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a\": container with ID starting with b59ccc99f74d5f70009b7cdd3ecfff8cdc7bbc67992b589a493bb54bc509a51a not found: ID does not exist" Oct 30 22:33:50.494931 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.494887 4497 scope.go:122] "RemoveContainer" containerID="45b702427fd69c08e31684abf770aa1a2e08a7177c3a1ce411677948529b3d39" Oct 30 22:33:50.495087 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.495072 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b702427fd69c08e31684abf770aa1a2e08a7177c3a1ce411677948529b3d39"} err="failed to get container status \"45b702427fd69c08e31684abf770aa1a2e08a7177c3a1ce411677948529b3d39\": rpc error: code = NotFound desc = could not find container \"45b702427fd69c08e31684abf770aa1a2e08a7177c3a1ce411677948529b3d39\": container with ID starting with 45b702427fd69c08e31684abf770aa1a2e08a7177c3a1ce411677948529b3d39 not found: ID does not exist" Oct 30 22:33:50.495134 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.495088 4497 scope.go:122] "RemoveContainer" containerID="5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516" Oct 30 22:33:50.495299 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.495278 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516"} err="failed to get container status \"5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516\": rpc error: code = NotFound desc = could not find container \"5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516\": container with ID starting with 5f8142f0bfc3ef2878fa955242e253f3844350938dcd4d84086e21f3a2b89516 not found: ID does not exist" Oct 30 22:33:50.688019 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.687991 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z"] Oct 30 22:33:50.737851 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:50.737778 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-55b9c49854-mj88z"] Oct 30 22:33:51.539967 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:51.539931 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" path="/var/lib/kubelet/pods/1e89234e-ae6c-435a-8f91-949845e4d3c1/volumes" Oct 30 22:33:52.228843 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:52.228809 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:53.155095 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.155061 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc"] Oct 30 22:33:53.155379 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.155367 4497 cpu_manager.go:414] "containerMap: removing container" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="agent" Oct 30 22:33:53.155435 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.155380 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="agent" Oct 30 22:33:53.155435 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.155397 4497 cpu_manager.go:414] "containerMap: removing container" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="kube-rbac-proxy" Oct 30 22:33:53.155435 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.155402 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="kube-rbac-proxy" Oct 30 22:33:53.155435 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.155419 4497 cpu_manager.go:414] "containerMap: removing container" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="kserve-container" Oct 30 22:33:53.155435 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.155424 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="kserve-container" Oct 30 22:33:53.155649 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.155473 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="agent" Oct 30 22:33:53.155649 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.155482 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="kube-rbac-proxy" Oct 30 22:33:53.155649 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.155489 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="1e89234e-ae6c-435a-8f91-949845e4d3c1" containerName="kserve-container" Oct 30 22:33:53.160057 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.160042 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:33:53.211075 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.211049 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zclwx\" (UniqueName: \"kubernetes.io/projected/82f03be2-4a01-4d89-a33d-b41ecfb89e83-kube-api-access-zclwx\") pod \"proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc\" (UID: \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:33:53.211204 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.211094 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/82f03be2-4a01-4d89-a33d-b41ecfb89e83-proxy-tls\") pod \"proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc\" (UID: \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:33:53.211204 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.211120 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/82f03be2-4a01-4d89-a33d-b41ecfb89e83-kube-rbac-proxy-sar-config\") pod \"proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc\" (UID: \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:33:53.263930 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.263892 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc"] Oct 30 22:33:53.311804 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.311774 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zclwx\" (UniqueName: \"kubernetes.io/projected/82f03be2-4a01-4d89-a33d-b41ecfb89e83-kube-api-access-zclwx\") pod \"proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc\" (UID: \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:33:53.311928 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.311818 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/82f03be2-4a01-4d89-a33d-b41ecfb89e83-proxy-tls\") pod \"proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc\" (UID: \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:33:53.311928 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.311840 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/82f03be2-4a01-4d89-a33d-b41ecfb89e83-kube-rbac-proxy-sar-config\") pod \"proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc\" (UID: \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:33:53.311928 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.311864 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b75702ab-7503-48bc-9a90-a65b0e03c365\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\") pod \"proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc\" (UID: \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:33:53.312051 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.311954 4497 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b75702ab-7503-48bc-9a90-a65b0e03c365\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\") pod \"proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc\" (UID: \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\") DevicePath \"csi-6b76a1e92dbe033b04a84c3848d37de2767f19ba9e254ffa2e04e62e70e70483\"" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:33:53.312590 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.312571 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/82f03be2-4a01-4d89-a33d-b41ecfb89e83-kube-rbac-proxy-sar-config\") pod \"proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc\" (UID: \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:33:53.314299 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.314282 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/82f03be2-4a01-4d89-a33d-b41ecfb89e83-proxy-tls\") pod \"proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc\" (UID: \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:33:53.364663 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.364637 4497 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b75702ab-7503-48bc-9a90-a65b0e03c365\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\") pod \"proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc\" (UID: \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\") DevicePath \"csi-6b76a1e92dbe033b04a84c3848d37de2767f19ba9e254ffa2e04e62e70e70483\"" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:33:53.374681 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.374658 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zclwx\" (UniqueName: \"kubernetes.io/projected/82f03be2-4a01-4d89-a33d-b41ecfb89e83-kube-api-access-zclwx\") pod \"proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc\" (UID: \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:33:53.427377 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.427314 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b75702ab-7503-48bc-9a90-a65b0e03c365\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\") pod \"proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc\" (UID: \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\") " pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:33:53.777153 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:53.777065 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:33:54.202809 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:54.202784 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc"] Oct 30 22:33:54.204916 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:33:54.204894 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82f03be2_4a01_4d89_a33d_b41ecfb89e83.slice/crio-64154d8551b0721e1e0e913d611875fea06be4829c849183aee4900df1d450a2 WatchSource:0}: Error finding container 64154d8551b0721e1e0e913d611875fea06be4829c849183aee4900df1d450a2: Status 404 returned error can't find the container with id 64154d8551b0721e1e0e913d611875fea06be4829c849183aee4900df1d450a2 Oct 30 22:33:54.494563 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:54.494472 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" event={"ID":"82f03be2-4a01-4d89-a33d-b41ecfb89e83","Type":"ContainerStarted","Data":"868a3c3427ecf93ffb41aa1e3aae7be7c858a9ff322f0a8dfd5b92c1fd9bbee5"} Oct 30 22:33:54.494563 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:54.494541 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" event={"ID":"82f03be2-4a01-4d89-a33d-b41ecfb89e83","Type":"ContainerStarted","Data":"a838cac7f2ab01d068df51536bd43105f3860467d5cabf1ae6a7e8e5e3dfd387"} Oct 30 22:33:54.495106 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:54.494566 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" event={"ID":"82f03be2-4a01-4d89-a33d-b41ecfb89e83","Type":"ContainerStarted","Data":"adbd0e0efdb4f39d46a85148331f1c13eb37f8993417c48343904d088b17b417"} Oct 30 22:33:54.495106 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:54.494594 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" event={"ID":"82f03be2-4a01-4d89-a33d-b41ecfb89e83","Type":"ContainerStarted","Data":"64154d8551b0721e1e0e913d611875fea06be4829c849183aee4900df1d450a2"} Oct 30 22:33:54.495106 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:54.494620 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:33:54.495106 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:54.494646 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:33:54.496263 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:54.496210 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="kserve-container" probeResult="failure" output="Get \"http://10.133.0.42:8081/\": dial tcp 10.133.0.42:8081: connect: connection refused" Oct 30 22:33:54.624680 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:54.624629 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" podStartSLOduration=1.6246144519999999 podStartE2EDuration="1.624614452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:33:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:33:54.624378227 +0000 UTC m=+1529.251443777" watchObservedRunningTime="2026-10-30 22:33:54.624614452 +0000 UTC m=+1529.251680002" Oct 30 22:33:55.499582 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:55.499550 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:33:55.500885 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:55.500861 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:33:55.501429 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:33:55.501408 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:33:59.658316 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:33:59.658279 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:34:00.884379 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:00.884342 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:34:01.275405 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:01.275308 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:34:02.512227 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:02.512200 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:34:02.735561 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:02.735531 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d"] Oct 30 22:34:02.735815 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:02.735770 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="kserve-container" containerID="cri-o://aa83fec829446a3874aeae82c692cff29cd86d00782b102b7daf6c9b30f3732c" gracePeriod=30 Oct 30 22:34:02.735815 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:02.735787 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="agent" containerID="cri-o://69776932ee48393aed02fb32e515c695536cc3a9a71330803ac15caed8de4acd" gracePeriod=30 Oct 30 22:34:02.736006 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:02.735797 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="kube-rbac-proxy" containerID="cri-o://16831f062d1567098422e05c192d4e31fb21c5e603c891f25fe70da0d67d2522" gracePeriod=30 Oct 30 22:34:03.535052 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:03.535012 4497 generic.go:356] "Generic (PLEG): container finished" podID="3522144d-8aab-4321-85a7-49c888db8ffe" containerID="16831f062d1567098422e05c192d4e31fb21c5e603c891f25fe70da0d67d2522" exitCode=0 Oct 30 22:34:03.538600 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:03.538571 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" event={"ID":"3522144d-8aab-4321-85a7-49c888db8ffe","Type":"ContainerDied","Data":"16831f062d1567098422e05c192d4e31fb21c5e603c891f25fe70da0d67d2522"} Oct 30 22:34:04.322536 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:04.322497 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.41:8643/healthz\": dial tcp 10.133.0.41:8643: connect: connection refused" Oct 30 22:34:09.321964 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:09.321921 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.41:8643/healthz\": dial tcp 10.133.0.41:8643: connect: connection refused" Oct 30 22:34:12.314877 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:12.314830 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:34:14.321872 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:14.321830 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.41:8643/healthz\": dial tcp 10.133.0.41:8643: connect: connection refused" Oct 30 22:34:14.322312 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:14.321962 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:34:19.322096 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:19.322049 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.41:8643/healthz\": dial tcp 10.133.0.41:8643: connect: connection refused" Oct 30 22:34:21.093215 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:21.093184 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:34:22.315539 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:22.315501 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:34:24.322816 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:24.322770 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.41:8643/healthz\": dial tcp 10.133.0.41:8643: connect: connection refused" Oct 30 22:34:29.321979 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:29.321935 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.41:8643/healthz\": dial tcp 10.133.0.41:8643: connect: connection refused" Oct 30 22:34:29.654252 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:34:29.654202 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:34:32.315336 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:32.315299 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:34:32.315758 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:32.315432 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:34:32.904285 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:32.904262 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:34:33.039175 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.039099 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3522144d-8aab-4321-85a7-49c888db8ffe-proxy-tls\" (UniqueName: \"kubernetes.io/secret/3522144d-8aab-4321-85a7-49c888db8ffe-proxy-tls\") pod \"3522144d-8aab-4321-85a7-49c888db8ffe\" (UID: \"3522144d-8aab-4321-85a7-49c888db8ffe\") " Oct 30 22:34:33.039333 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.039177 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3522144d-8aab-4321-85a7-49c888db8ffe-kube-api-access-j96rf\" (UniqueName: \"kubernetes.io/projected/3522144d-8aab-4321-85a7-49c888db8ffe-kube-api-access-j96rf\") pod \"3522144d-8aab-4321-85a7-49c888db8ffe\" (UID: \"3522144d-8aab-4321-85a7-49c888db8ffe\") " Oct 30 22:34:33.039333 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.039297 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\") pod \"3522144d-8aab-4321-85a7-49c888db8ffe\" (UID: \"3522144d-8aab-4321-85a7-49c888db8ffe\") " Oct 30 22:34:33.039333 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.039330 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3522144d-8aab-4321-85a7-49c888db8ffe-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3522144d-8aab-4321-85a7-49c888db8ffe-kube-rbac-proxy-sar-config\") pod \"3522144d-8aab-4321-85a7-49c888db8ffe\" (UID: \"3522144d-8aab-4321-85a7-49c888db8ffe\") " Oct 30 22:34:33.039721 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.039695 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3522144d-8aab-4321-85a7-49c888db8ffe-kube-rbac-proxy-sar-config" pod "3522144d-8aab-4321-85a7-49c888db8ffe" (UID: "3522144d-8aab-4321-85a7-49c888db8ffe"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:34:33.041503 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.041471 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3522144d-8aab-4321-85a7-49c888db8ffe-proxy-tls" pod "3522144d-8aab-4321-85a7-49c888db8ffe" (UID: "3522144d-8aab-4321-85a7-49c888db8ffe"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:34:33.041678 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.041649 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3522144d-8aab-4321-85a7-49c888db8ffe-kube-api-access-j96rf" pod "3522144d-8aab-4321-85a7-49c888db8ffe" (UID: "3522144d-8aab-4321-85a7-49c888db8ffe"). InnerVolumeSpecName "kube-api-access-j96rf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:34:33.042401 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.042382 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00" pod "3522144d-8aab-4321-85a7-49c888db8ffe" (UID: "3522144d-8aab-4321-85a7-49c888db8ffe"). InnerVolumeSpecName "pvc-b75702ab-7503-48bc-9a90-a65b0e03c365". PluginName "kubernetes.io/csi", VolumeGIDValue "" Oct 30 22:34:33.139919 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.139895 4497 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3522144d-8aab-4321-85a7-49c888db8ffe-proxy-tls\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:34:33.139919 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.139919 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j96rf\" (UniqueName: \"kubernetes.io/projected/3522144d-8aab-4321-85a7-49c888db8ffe-kube-api-access-j96rf\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:34:33.140073 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.139929 4497 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3522144d-8aab-4321-85a7-49c888db8ffe-kube-rbac-proxy-sar-config\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:34:33.656636 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.656598 4497 generic.go:356] "Generic (PLEG): container finished" podID="3522144d-8aab-4321-85a7-49c888db8ffe" containerID="69776932ee48393aed02fb32e515c695536cc3a9a71330803ac15caed8de4acd" exitCode=0 Oct 30 22:34:33.656636 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.656627 4497 generic.go:356] "Generic (PLEG): container finished" podID="3522144d-8aab-4321-85a7-49c888db8ffe" containerID="aa83fec829446a3874aeae82c692cff29cd86d00782b102b7daf6c9b30f3732c" exitCode=137 Oct 30 22:34:33.657126 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.656647 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" event={"ID":"3522144d-8aab-4321-85a7-49c888db8ffe","Type":"ContainerDied","Data":"69776932ee48393aed02fb32e515c695536cc3a9a71330803ac15caed8de4acd"} Oct 30 22:34:33.657126 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.656661 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" Oct 30 22:34:33.657126 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.656723 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" event={"ID":"3522144d-8aab-4321-85a7-49c888db8ffe","Type":"ContainerDied","Data":"aa83fec829446a3874aeae82c692cff29cd86d00782b102b7daf6c9b30f3732c"} Oct 30 22:34:33.657126 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.656749 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d" event={"ID":"3522144d-8aab-4321-85a7-49c888db8ffe","Type":"ContainerDied","Data":"efccc37f6bd7a533a8f2a3a16e5608ddda7d695fa946ee685357ad8a55bdd47c"} Oct 30 22:34:33.657126 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.656775 4497 scope.go:122] "RemoveContainer" containerID="69776932ee48393aed02fb32e515c695536cc3a9a71330803ac15caed8de4acd" Oct 30 22:34:33.664703 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.664681 4497 scope.go:122] "RemoveContainer" containerID="16831f062d1567098422e05c192d4e31fb21c5e603c891f25fe70da0d67d2522" Oct 30 22:34:33.671803 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.671787 4497 scope.go:122] "RemoveContainer" containerID="aa83fec829446a3874aeae82c692cff29cd86d00782b102b7daf6c9b30f3732c" Oct 30 22:34:33.678576 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.678560 4497 scope.go:122] "RemoveContainer" containerID="69776932ee48393aed02fb32e515c695536cc3a9a71330803ac15caed8de4acd" Oct 30 22:34:33.678845 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:34:33.678828 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69776932ee48393aed02fb32e515c695536cc3a9a71330803ac15caed8de4acd\": container with ID starting with 69776932ee48393aed02fb32e515c695536cc3a9a71330803ac15caed8de4acd not found: ID does not exist" containerID="69776932ee48393aed02fb32e515c695536cc3a9a71330803ac15caed8de4acd" Oct 30 22:34:33.678890 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.678853 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69776932ee48393aed02fb32e515c695536cc3a9a71330803ac15caed8de4acd"} err="failed to get container status \"69776932ee48393aed02fb32e515c695536cc3a9a71330803ac15caed8de4acd\": rpc error: code = NotFound desc = could not find container \"69776932ee48393aed02fb32e515c695536cc3a9a71330803ac15caed8de4acd\": container with ID starting with 69776932ee48393aed02fb32e515c695536cc3a9a71330803ac15caed8de4acd not found: ID does not exist" Oct 30 22:34:33.678890 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.678871 4497 scope.go:122] "RemoveContainer" containerID="16831f062d1567098422e05c192d4e31fb21c5e603c891f25fe70da0d67d2522" Oct 30 22:34:33.679109 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:34:33.679089 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16831f062d1567098422e05c192d4e31fb21c5e603c891f25fe70da0d67d2522\": container with ID starting with 16831f062d1567098422e05c192d4e31fb21c5e603c891f25fe70da0d67d2522 not found: ID does not exist" containerID="16831f062d1567098422e05c192d4e31fb21c5e603c891f25fe70da0d67d2522" Oct 30 22:34:33.679153 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.679116 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16831f062d1567098422e05c192d4e31fb21c5e603c891f25fe70da0d67d2522"} err="failed to get container status \"16831f062d1567098422e05c192d4e31fb21c5e603c891f25fe70da0d67d2522\": rpc error: code = NotFound desc = could not find container \"16831f062d1567098422e05c192d4e31fb21c5e603c891f25fe70da0d67d2522\": container with ID starting with 16831f062d1567098422e05c192d4e31fb21c5e603c891f25fe70da0d67d2522 not found: ID does not exist" Oct 30 22:34:33.679153 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.679132 4497 scope.go:122] "RemoveContainer" containerID="aa83fec829446a3874aeae82c692cff29cd86d00782b102b7daf6c9b30f3732c" Oct 30 22:34:33.679386 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:34:33.679370 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa83fec829446a3874aeae82c692cff29cd86d00782b102b7daf6c9b30f3732c\": container with ID starting with aa83fec829446a3874aeae82c692cff29cd86d00782b102b7daf6c9b30f3732c not found: ID does not exist" containerID="aa83fec829446a3874aeae82c692cff29cd86d00782b102b7daf6c9b30f3732c" Oct 30 22:34:33.679431 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.679391 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa83fec829446a3874aeae82c692cff29cd86d00782b102b7daf6c9b30f3732c"} err="failed to get container status \"aa83fec829446a3874aeae82c692cff29cd86d00782b102b7daf6c9b30f3732c\": rpc error: code = NotFound desc = could not find container \"aa83fec829446a3874aeae82c692cff29cd86d00782b102b7daf6c9b30f3732c\": container with ID starting with aa83fec829446a3874aeae82c692cff29cd86d00782b102b7daf6c9b30f3732c not found: ID does not exist" Oct 30 22:34:33.679431 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.679404 4497 scope.go:122] "RemoveContainer" containerID="69776932ee48393aed02fb32e515c695536cc3a9a71330803ac15caed8de4acd" Oct 30 22:34:33.679611 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.679593 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69776932ee48393aed02fb32e515c695536cc3a9a71330803ac15caed8de4acd"} err="failed to get container status \"69776932ee48393aed02fb32e515c695536cc3a9a71330803ac15caed8de4acd\": rpc error: code = NotFound desc = could not find container \"69776932ee48393aed02fb32e515c695536cc3a9a71330803ac15caed8de4acd\": container with ID starting with 69776932ee48393aed02fb32e515c695536cc3a9a71330803ac15caed8de4acd not found: ID does not exist" Oct 30 22:34:33.679657 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.679612 4497 scope.go:122] "RemoveContainer" containerID="16831f062d1567098422e05c192d4e31fb21c5e603c891f25fe70da0d67d2522" Oct 30 22:34:33.679829 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.679813 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16831f062d1567098422e05c192d4e31fb21c5e603c891f25fe70da0d67d2522"} err="failed to get container status \"16831f062d1567098422e05c192d4e31fb21c5e603c891f25fe70da0d67d2522\": rpc error: code = NotFound desc = could not find container \"16831f062d1567098422e05c192d4e31fb21c5e603c891f25fe70da0d67d2522\": container with ID starting with 16831f062d1567098422e05c192d4e31fb21c5e603c891f25fe70da0d67d2522 not found: ID does not exist" Oct 30 22:34:33.679878 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.679830 4497 scope.go:122] "RemoveContainer" containerID="aa83fec829446a3874aeae82c692cff29cd86d00782b102b7daf6c9b30f3732c" Oct 30 22:34:33.680050 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.680035 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa83fec829446a3874aeae82c692cff29cd86d00782b102b7daf6c9b30f3732c"} err="failed to get container status \"aa83fec829446a3874aeae82c692cff29cd86d00782b102b7daf6c9b30f3732c\": rpc error: code = NotFound desc = could not find container \"aa83fec829446a3874aeae82c692cff29cd86d00782b102b7daf6c9b30f3732c\": container with ID starting with aa83fec829446a3874aeae82c692cff29cd86d00782b102b7daf6c9b30f3732c not found: ID does not exist" Oct 30 22:34:33.874677 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.874654 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d"] Oct 30 22:34:33.924314 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:33.924275 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-5cf598885b-qhs9d"] Oct 30 22:34:34.748102 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:34.748063 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p"] Oct 30 22:34:34.748582 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:34.748325 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p" podUID="9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7" containerName="kserve-container" containerID="cri-o://9d643f14e24506176537b3362c96820922aabc65ec2c169de6ebc2f7c2cbcdea" gracePeriod=30 Oct 30 22:34:34.912930 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:34.912901 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:34:35.214970 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:35.214932 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:34:35.539561 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:35.539483 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" path="/var/lib/kubelet/pods/3522144d-8aab-4321-85a7-49c888db8ffe/volumes" Oct 30 22:34:36.080630 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:36.080543 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc"] Oct 30 22:34:36.081113 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:36.080807 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="kserve-container" containerID="cri-o://adbd0e0efdb4f39d46a85148331f1c13eb37f8993417c48343904d088b17b417" gracePeriod=30 Oct 30 22:34:36.081113 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:36.080848 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="agent" containerID="cri-o://868a3c3427ecf93ffb41aa1e3aae7be7c858a9ff322f0a8dfd5b92c1fd9bbee5" gracePeriod=30 Oct 30 22:34:36.081113 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:36.080857 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="kube-rbac-proxy" containerID="cri-o://a838cac7f2ab01d068df51536bd43105f3860467d5cabf1ae6a7e8e5e3dfd387" gracePeriod=30 Oct 30 22:34:36.182489 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:36.182451 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:34:36.671866 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:36.671833 4497 generic.go:356] "Generic (PLEG): container finished" podID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerID="a838cac7f2ab01d068df51536bd43105f3860467d5cabf1ae6a7e8e5e3dfd387" exitCode=0 Oct 30 22:34:36.672072 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:36.671913 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" event={"ID":"82f03be2-4a01-4d89-a33d-b41ecfb89e83","Type":"ContainerDied","Data":"a838cac7f2ab01d068df51536bd43105f3860467d5cabf1ae6a7e8e5e3dfd387"} Oct 30 22:34:37.508582 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:37.508540 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.42:8643/healthz\": dial tcp 10.133.0.42:8643: connect: connection refused" Oct 30 22:34:42.508726 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:42.508676 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.42:8643/healthz\": dial tcp 10.133.0.42:8643: connect: connection refused" Oct 30 22:34:45.500283 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:45.500220 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:34:47.507896 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:47.507855 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.42:8643/healthz\": dial tcp 10.133.0.42:8643: connect: connection refused" Oct 30 22:34:47.508336 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:47.507973 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:34:52.508641 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:52.508596 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.42:8643/healthz\": dial tcp 10.133.0.42:8643: connect: connection refused" Oct 30 22:34:55.500134 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:55.500087 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:34:57.508472 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:34:57.508426 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.42:8643/healthz\": dial tcp 10.133.0.42:8643: connect: connection refused" Oct 30 22:34:59.653038 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:34:59.653001 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:35:02.508827 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:02.508774 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.42:8643/healthz\": dial tcp 10.133.0.42:8643: connect: connection refused" Oct 30 22:35:04.934665 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:04.934641 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p" Oct 30 22:35:04.983058 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:04.983033 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7-kube-api-access-nw4n4\" (UniqueName: \"kubernetes.io/projected/9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7-kube-api-access-nw4n4\") pod \"9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7\" (UID: \"9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7\") " Oct 30 22:35:04.985129 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:04.985108 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7-kube-api-access-nw4n4" pod "9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7" (UID: "9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7"). InnerVolumeSpecName "kube-api-access-nw4n4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:35:05.084401 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:05.084334 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nw4n4\" (UniqueName: \"kubernetes.io/projected/9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7-kube-api-access-nw4n4\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:35:05.500479 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:05.500441 4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:35:05.500646 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:05.500561 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:35:05.791187 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:05.791103 4497 generic.go:356] "Generic (PLEG): container finished" podID="9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7" containerID="9d643f14e24506176537b3362c96820922aabc65ec2c169de6ebc2f7c2cbcdea" exitCode=137 Oct 30 22:35:05.791187 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:05.791150 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p" Oct 30 22:35:05.791434 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:05.791191 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p" event={"ID":"9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7","Type":"ContainerDied","Data":"9d643f14e24506176537b3362c96820922aabc65ec2c169de6ebc2f7c2cbcdea"} Oct 30 22:35:05.791434 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:05.791252 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p" event={"ID":"9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7","Type":"ContainerDied","Data":"de3074b926061d51530a28ffeb6cf6dc66ae8526018a79617449fefed8c6cc46"} Oct 30 22:35:05.791434 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:05.791274 4497 scope.go:122] "RemoveContainer" containerID="9d643f14e24506176537b3362c96820922aabc65ec2c169de6ebc2f7c2cbcdea" Oct 30 22:35:05.798955 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:05.798936 4497 scope.go:122] "RemoveContainer" containerID="9d643f14e24506176537b3362c96820922aabc65ec2c169de6ebc2f7c2cbcdea" Oct 30 22:35:05.799227 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:35:05.799207 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d643f14e24506176537b3362c96820922aabc65ec2c169de6ebc2f7c2cbcdea\": container with ID starting with 9d643f14e24506176537b3362c96820922aabc65ec2c169de6ebc2f7c2cbcdea not found: ID does not exist" containerID="9d643f14e24506176537b3362c96820922aabc65ec2c169de6ebc2f7c2cbcdea" Oct 30 22:35:05.799350 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:05.799233 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d643f14e24506176537b3362c96820922aabc65ec2c169de6ebc2f7c2cbcdea"} err="failed to get container status \"9d643f14e24506176537b3362c96820922aabc65ec2c169de6ebc2f7c2cbcdea\": rpc error: code = NotFound desc = could not find container \"9d643f14e24506176537b3362c96820922aabc65ec2c169de6ebc2f7c2cbcdea\": container with ID starting with 9d643f14e24506176537b3362c96820922aabc65ec2c169de6ebc2f7c2cbcdea not found: ID does not exist" Oct 30 22:35:05.956979 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:05.956952 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p"] Oct 30 22:35:05.964388 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:05.964367 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-sink-796874dd78-4xj4p"] Oct 30 22:35:06.269120 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.269100 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:35:06.293084 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.293065 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\") pod \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\" (UID: \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\") " Oct 30 22:35:06.293201 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.293105 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/82f03be2-4a01-4d89-a33d-b41ecfb89e83-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/82f03be2-4a01-4d89-a33d-b41ecfb89e83-kube-rbac-proxy-sar-config\") pod \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\" (UID: \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\") " Oct 30 22:35:06.293201 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.293135 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/82f03be2-4a01-4d89-a33d-b41ecfb89e83-proxy-tls\" (UniqueName: \"kubernetes.io/secret/82f03be2-4a01-4d89-a33d-b41ecfb89e83-proxy-tls\") pod \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\" (UID: \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\") " Oct 30 22:35:06.293201 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.293172 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/82f03be2-4a01-4d89-a33d-b41ecfb89e83-kube-api-access-zclwx\" (UniqueName: \"kubernetes.io/projected/82f03be2-4a01-4d89-a33d-b41ecfb89e83-kube-api-access-zclwx\") pod \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\" (UID: \"82f03be2-4a01-4d89-a33d-b41ecfb89e83\") " Oct 30 22:35:06.293542 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.293511 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82f03be2-4a01-4d89-a33d-b41ecfb89e83-kube-rbac-proxy-sar-config" pod "82f03be2-4a01-4d89-a33d-b41ecfb89e83" (UID: "82f03be2-4a01-4d89-a33d-b41ecfb89e83"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:35:06.295434 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.295399 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82f03be2-4a01-4d89-a33d-b41ecfb89e83-proxy-tls" pod "82f03be2-4a01-4d89-a33d-b41ecfb89e83" (UID: "82f03be2-4a01-4d89-a33d-b41ecfb89e83"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:35:06.295434 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.295399 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82f03be2-4a01-4d89-a33d-b41ecfb89e83-kube-api-access-zclwx" pod "82f03be2-4a01-4d89-a33d-b41ecfb89e83" (UID: "82f03be2-4a01-4d89-a33d-b41ecfb89e83"). InnerVolumeSpecName "kube-api-access-zclwx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:35:06.295814 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.295796 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00" pod "82f03be2-4a01-4d89-a33d-b41ecfb89e83" (UID: "82f03be2-4a01-4d89-a33d-b41ecfb89e83"). InnerVolumeSpecName "pvc-b75702ab-7503-48bc-9a90-a65b0e03c365". PluginName "kubernetes.io/csi", VolumeGIDValue "" Oct 30 22:35:06.393921 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.393900 4497 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b75702ab-7503-48bc-9a90-a65b0e03c365\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" " Oct 30 22:35:06.393921 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.393923 4497 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/82f03be2-4a01-4d89-a33d-b41ecfb89e83-kube-rbac-proxy-sar-config\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:35:06.394091 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.393932 4497 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/82f03be2-4a01-4d89-a33d-b41ecfb89e83-proxy-tls\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:35:06.394091 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.393943 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zclwx\" (UniqueName: \"kubernetes.io/projected/82f03be2-4a01-4d89-a33d-b41ecfb89e83-kube-api-access-zclwx\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:35:06.403562 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.403546 4497 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b75702ab-7503-48bc-9a90-a65b0e03c365" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00") on node "ip-10-0-129-150.us-west-1.compute.internal" Oct 30 22:35:06.494726 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.494694 4497 reconciler_common.go:299] "Volume detached for volume \"pvc-b75702ab-7503-48bc-9a90-a65b0e03c365\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0c4c0f47e49b4ac00\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"csi-6b76a1e92dbe033b04a84c3848d37de2767f19ba9e254ffa2e04e62e70e70483\"" Oct 30 22:35:06.797019 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.796937 4497 generic.go:356] "Generic (PLEG): container finished" podID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerID="868a3c3427ecf93ffb41aa1e3aae7be7c858a9ff322f0a8dfd5b92c1fd9bbee5" exitCode=0 Oct 30 22:35:06.797019 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.796962 4497 generic.go:356] "Generic (PLEG): container finished" podID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerID="adbd0e0efdb4f39d46a85148331f1c13eb37f8993417c48343904d088b17b417" exitCode=137 Oct 30 22:35:06.797019 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.796999 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" Oct 30 22:35:06.797305 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.797015 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" event={"ID":"82f03be2-4a01-4d89-a33d-b41ecfb89e83","Type":"ContainerDied","Data":"868a3c3427ecf93ffb41aa1e3aae7be7c858a9ff322f0a8dfd5b92c1fd9bbee5"} Oct 30 22:35:06.797305 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.797089 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" event={"ID":"82f03be2-4a01-4d89-a33d-b41ecfb89e83","Type":"ContainerDied","Data":"adbd0e0efdb4f39d46a85148331f1c13eb37f8993417c48343904d088b17b417"} Oct 30 22:35:06.797305 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.797129 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc" event={"ID":"82f03be2-4a01-4d89-a33d-b41ecfb89e83","Type":"ContainerDied","Data":"64154d8551b0721e1e0e913d611875fea06be4829c849183aee4900df1d450a2"} Oct 30 22:35:06.797305 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.797145 4497 scope.go:122] "RemoveContainer" containerID="868a3c3427ecf93ffb41aa1e3aae7be7c858a9ff322f0a8dfd5b92c1fd9bbee5" Oct 30 22:35:06.805635 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.805616 4497 scope.go:122] "RemoveContainer" containerID="a838cac7f2ab01d068df51536bd43105f3860467d5cabf1ae6a7e8e5e3dfd387" Oct 30 22:35:06.812692 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.812677 4497 scope.go:122] "RemoveContainer" containerID="adbd0e0efdb4f39d46a85148331f1c13eb37f8993417c48343904d088b17b417" Oct 30 22:35:06.819838 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.819821 4497 scope.go:122] "RemoveContainer" containerID="868a3c3427ecf93ffb41aa1e3aae7be7c858a9ff322f0a8dfd5b92c1fd9bbee5" Oct 30 22:35:06.820080 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:35:06.820062 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"868a3c3427ecf93ffb41aa1e3aae7be7c858a9ff322f0a8dfd5b92c1fd9bbee5\": container with ID starting with 868a3c3427ecf93ffb41aa1e3aae7be7c858a9ff322f0a8dfd5b92c1fd9bbee5 not found: ID does not exist" containerID="868a3c3427ecf93ffb41aa1e3aae7be7c858a9ff322f0a8dfd5b92c1fd9bbee5" Oct 30 22:35:06.820130 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.820090 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"868a3c3427ecf93ffb41aa1e3aae7be7c858a9ff322f0a8dfd5b92c1fd9bbee5"} err="failed to get container status \"868a3c3427ecf93ffb41aa1e3aae7be7c858a9ff322f0a8dfd5b92c1fd9bbee5\": rpc error: code = NotFound desc = could not find container \"868a3c3427ecf93ffb41aa1e3aae7be7c858a9ff322f0a8dfd5b92c1fd9bbee5\": container with ID starting with 868a3c3427ecf93ffb41aa1e3aae7be7c858a9ff322f0a8dfd5b92c1fd9bbee5 not found: ID does not exist" Oct 30 22:35:06.820130 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.820106 4497 scope.go:122] "RemoveContainer" containerID="a838cac7f2ab01d068df51536bd43105f3860467d5cabf1ae6a7e8e5e3dfd387" Oct 30 22:35:06.820361 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:35:06.820345 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a838cac7f2ab01d068df51536bd43105f3860467d5cabf1ae6a7e8e5e3dfd387\": container with ID starting with a838cac7f2ab01d068df51536bd43105f3860467d5cabf1ae6a7e8e5e3dfd387 not found: ID does not exist" containerID="a838cac7f2ab01d068df51536bd43105f3860467d5cabf1ae6a7e8e5e3dfd387" Oct 30 22:35:06.820406 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.820368 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a838cac7f2ab01d068df51536bd43105f3860467d5cabf1ae6a7e8e5e3dfd387"} err="failed to get container status \"a838cac7f2ab01d068df51536bd43105f3860467d5cabf1ae6a7e8e5e3dfd387\": rpc error: code = NotFound desc = could not find container \"a838cac7f2ab01d068df51536bd43105f3860467d5cabf1ae6a7e8e5e3dfd387\": container with ID starting with a838cac7f2ab01d068df51536bd43105f3860467d5cabf1ae6a7e8e5e3dfd387 not found: ID does not exist" Oct 30 22:35:06.820406 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.820384 4497 scope.go:122] "RemoveContainer" containerID="adbd0e0efdb4f39d46a85148331f1c13eb37f8993417c48343904d088b17b417" Oct 30 22:35:06.820622 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:35:06.820605 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adbd0e0efdb4f39d46a85148331f1c13eb37f8993417c48343904d088b17b417\": container with ID starting with adbd0e0efdb4f39d46a85148331f1c13eb37f8993417c48343904d088b17b417 not found: ID does not exist" containerID="adbd0e0efdb4f39d46a85148331f1c13eb37f8993417c48343904d088b17b417" Oct 30 22:35:06.820669 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.820625 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adbd0e0efdb4f39d46a85148331f1c13eb37f8993417c48343904d088b17b417"} err="failed to get container status \"adbd0e0efdb4f39d46a85148331f1c13eb37f8993417c48343904d088b17b417\": rpc error: code = NotFound desc = could not find container \"adbd0e0efdb4f39d46a85148331f1c13eb37f8993417c48343904d088b17b417\": container with ID starting with adbd0e0efdb4f39d46a85148331f1c13eb37f8993417c48343904d088b17b417 not found: ID does not exist" Oct 30 22:35:06.820669 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.820638 4497 scope.go:122] "RemoveContainer" containerID="868a3c3427ecf93ffb41aa1e3aae7be7c858a9ff322f0a8dfd5b92c1fd9bbee5" Oct 30 22:35:06.820818 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.820802 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"868a3c3427ecf93ffb41aa1e3aae7be7c858a9ff322f0a8dfd5b92c1fd9bbee5"} err="failed to get container status \"868a3c3427ecf93ffb41aa1e3aae7be7c858a9ff322f0a8dfd5b92c1fd9bbee5\": rpc error: code = NotFound desc = could not find container \"868a3c3427ecf93ffb41aa1e3aae7be7c858a9ff322f0a8dfd5b92c1fd9bbee5\": container with ID starting with 868a3c3427ecf93ffb41aa1e3aae7be7c858a9ff322f0a8dfd5b92c1fd9bbee5 not found: ID does not exist" Oct 30 22:35:06.820863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.820819 4497 scope.go:122] "RemoveContainer" containerID="a838cac7f2ab01d068df51536bd43105f3860467d5cabf1ae6a7e8e5e3dfd387" Oct 30 22:35:06.821002 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.820988 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a838cac7f2ab01d068df51536bd43105f3860467d5cabf1ae6a7e8e5e3dfd387"} err="failed to get container status \"a838cac7f2ab01d068df51536bd43105f3860467d5cabf1ae6a7e8e5e3dfd387\": rpc error: code = NotFound desc = could not find container \"a838cac7f2ab01d068df51536bd43105f3860467d5cabf1ae6a7e8e5e3dfd387\": container with ID starting with a838cac7f2ab01d068df51536bd43105f3860467d5cabf1ae6a7e8e5e3dfd387 not found: ID does not exist" Oct 30 22:35:06.821049 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.821004 4497 scope.go:122] "RemoveContainer" containerID="adbd0e0efdb4f39d46a85148331f1c13eb37f8993417c48343904d088b17b417" Oct 30 22:35:06.821193 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.821177 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adbd0e0efdb4f39d46a85148331f1c13eb37f8993417c48343904d088b17b417"} err="failed to get container status \"adbd0e0efdb4f39d46a85148331f1c13eb37f8993417c48343904d088b17b417\": rpc error: code = NotFound desc = could not find container \"adbd0e0efdb4f39d46a85148331f1c13eb37f8993417c48343904d088b17b417\": container with ID starting with adbd0e0efdb4f39d46a85148331f1c13eb37f8993417c48343904d088b17b417 not found: ID does not exist" Oct 30 22:35:06.964786 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:06.964758 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc"] Oct 30 22:35:07.014454 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:07.014419 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-959ee2f135/proxy-routing-fee82af6-predictor-d7cf965dc-rkqsc"] Oct 30 22:35:07.168674 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:07.168647 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:35:07.422552 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:07.422515 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:35:07.538902 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:07.538866 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" path="/var/lib/kubelet/pods/82f03be2-4a01-4d89-a33d-b41ecfb89e83/volumes" Oct 30 22:35:07.539264 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:07.539252 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7" path="/var/lib/kubelet/pods/9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7/volumes" Oct 30 22:35:10.714588 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.714557 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:35:10.793571 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.793538 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5"] Oct 30 22:35:10.793840 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.793828 4497 cpu_manager.go:414] "containerMap: removing container" podUID="9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7" containerName="kserve-container" Oct 30 22:35:10.793890 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.793841 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7" containerName="kserve-container" Oct 30 22:35:10.793890 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.793852 4497 cpu_manager.go:414] "containerMap: removing container" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="agent" Oct 30 22:35:10.793890 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.793859 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="agent" Oct 30 22:35:10.793890 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.793871 4497 cpu_manager.go:414] "containerMap: removing container" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="kserve-container" Oct 30 22:35:10.793890 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.793875 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="kserve-container" Oct 30 22:35:10.793890 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.793885 4497 cpu_manager.go:414] "containerMap: removing container" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="kube-rbac-proxy" Oct 30 22:35:10.793890 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.793890 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="kube-rbac-proxy" Oct 30 22:35:10.794133 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.793902 4497 cpu_manager.go:414] "containerMap: removing container" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="kserve-container" Oct 30 22:35:10.794133 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.793907 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="kserve-container" Oct 30 22:35:10.794133 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.793918 4497 cpu_manager.go:414] "containerMap: removing container" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="kube-rbac-proxy" Oct 30 22:35:10.794133 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.793922 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="kube-rbac-proxy" Oct 30 22:35:10.794133 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.793931 4497 cpu_manager.go:414] "containerMap: removing container" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="agent" Oct 30 22:35:10.794133 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.793935 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="agent" Oct 30 22:35:10.794133 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.793982 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="kserve-container" Oct 30 22:35:10.794133 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.793989 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="kube-rbac-proxy" Oct 30 22:35:10.794133 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.793997 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="kserve-container" Oct 30 22:35:10.794133 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.794003 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="kube-rbac-proxy" Oct 30 22:35:10.794133 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.794010 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="3522144d-8aab-4321-85a7-49c888db8ffe" containerName="agent" Oct 30 22:35:10.794133 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.794017 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ee3fb5f-a06b-4f17-b2df-9eaf2bc58bf7" containerName="kserve-container" Oct 30 22:35:10.794133 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.794022 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="82f03be2-4a01-4d89-a33d-b41ecfb89e83" containerName="agent" Oct 30 22:35:10.798348 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.798330 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" Oct 30 22:35:10.825503 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.825469 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grwbx\" (UniqueName: \"kubernetes.io/projected/a4159464-ebd1-4350-8700-62d9c47d2b49-kube-api-access-grwbx\") pod \"message-dumper-predictor-544ddf8bbb-gcrl5\" (UID: \"a4159464-ebd1-4350-8700-62d9c47d2b49\") " pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" Oct 30 22:35:10.825644 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.825524 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a4159464-ebd1-4350-8700-62d9c47d2b49-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-544ddf8bbb-gcrl5\" (UID: \"a4159464-ebd1-4350-8700-62d9c47d2b49\") " pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" Oct 30 22:35:10.825644 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.825551 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4159464-ebd1-4350-8700-62d9c47d2b49-proxy-tls\") pod \"message-dumper-predictor-544ddf8bbb-gcrl5\" (UID: \"a4159464-ebd1-4350-8700-62d9c47d2b49\") " pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" Oct 30 22:35:10.901770 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.901737 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"kube-root-ca.crt\"" Oct 30 22:35:10.901770 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.901738 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"message-dumper-predictor-serving-cert\"" Oct 30 22:35:10.901958 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.901784 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"message-dumper-kube-rbac-proxy-sar-config\"" Oct 30 22:35:10.901958 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.901810 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-959ee2f135\"/\"default-dockercfg-s9cqw\"" Oct 30 22:35:10.901958 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.901826 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-959ee2f135\"/\"openshift-service-ca.crt\"" Oct 30 22:35:10.903458 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.903438 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5"] Oct 30 22:35:10.926434 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.926410 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grwbx\" (UniqueName: \"kubernetes.io/projected/a4159464-ebd1-4350-8700-62d9c47d2b49-kube-api-access-grwbx\") pod \"message-dumper-predictor-544ddf8bbb-gcrl5\" (UID: \"a4159464-ebd1-4350-8700-62d9c47d2b49\") " pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" Oct 30 22:35:10.926564 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.926473 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a4159464-ebd1-4350-8700-62d9c47d2b49-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-544ddf8bbb-gcrl5\" (UID: \"a4159464-ebd1-4350-8700-62d9c47d2b49\") " pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" Oct 30 22:35:10.926564 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.926499 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4159464-ebd1-4350-8700-62d9c47d2b49-proxy-tls\") pod \"message-dumper-predictor-544ddf8bbb-gcrl5\" (UID: \"a4159464-ebd1-4350-8700-62d9c47d2b49\") " pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" Oct 30 22:35:10.927230 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.927146 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a4159464-ebd1-4350-8700-62d9c47d2b49-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-544ddf8bbb-gcrl5\" (UID: \"a4159464-ebd1-4350-8700-62d9c47d2b49\") " pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" Oct 30 22:35:10.928995 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.928976 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4159464-ebd1-4350-8700-62d9c47d2b49-proxy-tls\") pod \"message-dumper-predictor-544ddf8bbb-gcrl5\" (UID: \"a4159464-ebd1-4350-8700-62d9c47d2b49\") " pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" Oct 30 22:35:10.989695 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:10.989634 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grwbx\" (UniqueName: \"kubernetes.io/projected/a4159464-ebd1-4350-8700-62d9c47d2b49-kube-api-access-grwbx\") pod \"message-dumper-predictor-544ddf8bbb-gcrl5\" (UID: \"a4159464-ebd1-4350-8700-62d9c47d2b49\") " pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" Oct 30 22:35:11.006013 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:11.005983 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:35:11.112079 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:11.112045 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" Oct 30 22:35:11.486203 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:11.486023 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5"] Oct 30 22:35:11.488768 ip-10-0-129-150 kubenswrapper[4497]: W1030 22:35:11.488739 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4159464_ebd1_4350_8700_62d9c47d2b49.slice/crio-fc0e5ac30da5ab61e4ad0e28bbf5bc723d02ea7eda3960967dfb8f38b0c80eed WatchSource:0}: Error finding container fc0e5ac30da5ab61e4ad0e28bbf5bc723d02ea7eda3960967dfb8f38b0c80eed: Status 404 returned error can't find the container with id fc0e5ac30da5ab61e4ad0e28bbf5bc723d02ea7eda3960967dfb8f38b0c80eed Oct 30 22:35:11.490724 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:11.490700 4497 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:35:11.824407 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:11.824325 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" event={"ID":"a4159464-ebd1-4350-8700-62d9c47d2b49","Type":"ContainerStarted","Data":"fc0e5ac30da5ab61e4ad0e28bbf5bc723d02ea7eda3960967dfb8f38b0c80eed"} Oct 30 22:35:13.833624 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:13.833540 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" event={"ID":"a4159464-ebd1-4350-8700-62d9c47d2b49","Type":"ContainerStarted","Data":"2763b7e071dd545d72507fe5d42184708ba171252bff032232611094edb38d2f"} Oct 30 22:35:13.833624 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:13.833605 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" event={"ID":"a4159464-ebd1-4350-8700-62d9c47d2b49","Type":"ContainerStarted","Data":"b6c65fa5463526aa8b91441bea3f872dab1419c60792c4b546c981d920e2b942"} Oct 30 22:35:13.834110 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:13.833638 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" Oct 30 22:35:13.834110 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:13.833668 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" Oct 30 22:35:13.835478 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:13.835459 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" Oct 30 22:35:13.958464 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:13.958299 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" podStartSLOduration=1.896241173 podStartE2EDuration="3.958283302s" totalImagesPullingTime="2.062042129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:35:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:35:13.957746578 +0000 UTC m=+1608.584812128" watchObservedRunningTime="2026-10-30 22:35:13.958283302 +0000 UTC m=+1608.585348853" Oct 30 22:35:20.845863 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:20.845833 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" Oct 30 22:35:21.365195 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:21.365152 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:35:22.450745 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:22.450713 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:35:22.752070 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:22.751981 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:35:29.653787 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:35:29.653747 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:35:30.958126 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:30.958089 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:35:31.229227 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:35:31.229140 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:35:59.653449 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:35:59.653413 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:36:21.740304 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:36:21.740197 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:36:29.654247 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:36:29.654192 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:36:59.654058 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:36:59.654024 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:37:02.068622 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:02.068584 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:12.482844 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:12.482799 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:12.825850 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:12.825762 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:15.761439 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:15.761404 4497 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-959ee2f135_message-dumper-predictor-544ddf8bbb-gcrl5_a4159464-ebd1-4350-8700-62d9c47d2b49/kserve-container/0.log" Oct 30 22:37:17.770230 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:17.770186 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:17.827841 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:17.827815 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5"] Oct 30 22:37:17.828052 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:17.828022 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" podUID="a4159464-ebd1-4350-8700-62d9c47d2b49" containerName="kserve-container" containerID="cri-o://b6c65fa5463526aa8b91441bea3f872dab1419c60792c4b546c981d920e2b942" gracePeriod=30 Oct 30 22:37:17.828192 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:17.828065 4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" podUID="a4159464-ebd1-4350-8700-62d9c47d2b49" containerName="kube-rbac-proxy" containerID="cri-o://2763b7e071dd545d72507fe5d42184708ba171252bff032232611094edb38d2f" gracePeriod=30 Oct 30 22:37:18.079792 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.079768 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" Oct 30 22:37:18.080716 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.080681 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:18.180291 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.180261 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a4159464-ebd1-4350-8700-62d9c47d2b49-proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4159464-ebd1-4350-8700-62d9c47d2b49-proxy-tls\") pod \"a4159464-ebd1-4350-8700-62d9c47d2b49\" (UID: \"a4159464-ebd1-4350-8700-62d9c47d2b49\") " Oct 30 22:37:18.180426 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.180333 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a4159464-ebd1-4350-8700-62d9c47d2b49-kube-api-access-grwbx\" (UniqueName: \"kubernetes.io/projected/a4159464-ebd1-4350-8700-62d9c47d2b49-kube-api-access-grwbx\") pod \"a4159464-ebd1-4350-8700-62d9c47d2b49\" (UID: \"a4159464-ebd1-4350-8700-62d9c47d2b49\") " Oct 30 22:37:18.180426 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.180389 4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a4159464-ebd1-4350-8700-62d9c47d2b49-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a4159464-ebd1-4350-8700-62d9c47d2b49-kube-rbac-proxy-sar-config\") pod \"a4159464-ebd1-4350-8700-62d9c47d2b49\" (UID: \"a4159464-ebd1-4350-8700-62d9c47d2b49\") " Oct 30 22:37:18.180751 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.180727 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4159464-ebd1-4350-8700-62d9c47d2b49-kube-rbac-proxy-sar-config" pod "a4159464-ebd1-4350-8700-62d9c47d2b49" (UID: "a4159464-ebd1-4350-8700-62d9c47d2b49"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:37:18.182519 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.182494 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4159464-ebd1-4350-8700-62d9c47d2b49-proxy-tls" pod "a4159464-ebd1-4350-8700-62d9c47d2b49" (UID: "a4159464-ebd1-4350-8700-62d9c47d2b49"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:37:18.182585 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.182525 4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4159464-ebd1-4350-8700-62d9c47d2b49-kube-api-access-grwbx" pod "a4159464-ebd1-4350-8700-62d9c47d2b49" (UID: "a4159464-ebd1-4350-8700-62d9c47d2b49"). InnerVolumeSpecName "kube-api-access-grwbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:37:18.280860 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.280827 4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grwbx\" (UniqueName: \"kubernetes.io/projected/a4159464-ebd1-4350-8700-62d9c47d2b49-kube-api-access-grwbx\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:37:18.280860 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.280852 4497 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a4159464-ebd1-4350-8700-62d9c47d2b49-kube-rbac-proxy-sar-config\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:37:18.280860 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.280861 4497 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4159464-ebd1-4350-8700-62d9c47d2b49-proxy-tls\") on node \"ip-10-0-129-150.us-west-1.compute.internal\" DevicePath \"\"" Oct 30 22:37:18.303619 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.303579 4497 generic.go:356] "Generic (PLEG): container finished" podID="a4159464-ebd1-4350-8700-62d9c47d2b49" containerID="2763b7e071dd545d72507fe5d42184708ba171252bff032232611094edb38d2f" exitCode=0 Oct 30 22:37:18.303619 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.303608 4497 generic.go:356] "Generic (PLEG): container finished" podID="a4159464-ebd1-4350-8700-62d9c47d2b49" containerID="b6c65fa5463526aa8b91441bea3f872dab1419c60792c4b546c981d920e2b942" exitCode=2 Oct 30 22:37:18.303796 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.303641 4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" Oct 30 22:37:18.303796 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.303658 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" event={"ID":"a4159464-ebd1-4350-8700-62d9c47d2b49","Type":"ContainerDied","Data":"2763b7e071dd545d72507fe5d42184708ba171252bff032232611094edb38d2f"} Oct 30 22:37:18.303796 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.303719 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" event={"ID":"a4159464-ebd1-4350-8700-62d9c47d2b49","Type":"ContainerDied","Data":"b6c65fa5463526aa8b91441bea3f872dab1419c60792c4b546c981d920e2b942"} Oct 30 22:37:18.303796 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.303741 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5" event={"ID":"a4159464-ebd1-4350-8700-62d9c47d2b49","Type":"ContainerDied","Data":"fc0e5ac30da5ab61e4ad0e28bbf5bc723d02ea7eda3960967dfb8f38b0c80eed"} Oct 30 22:37:18.303796 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.303765 4497 scope.go:122] "RemoveContainer" containerID="2763b7e071dd545d72507fe5d42184708ba171252bff032232611094edb38d2f" Oct 30 22:37:18.317995 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.317978 4497 scope.go:122] "RemoveContainer" containerID="b6c65fa5463526aa8b91441bea3f872dab1419c60792c4b546c981d920e2b942" Oct 30 22:37:18.325684 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.325662 4497 scope.go:122] "RemoveContainer" containerID="2763b7e071dd545d72507fe5d42184708ba171252bff032232611094edb38d2f" Oct 30 22:37:18.325945 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:37:18.325926 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2763b7e071dd545d72507fe5d42184708ba171252bff032232611094edb38d2f\": container with ID starting with 2763b7e071dd545d72507fe5d42184708ba171252bff032232611094edb38d2f not found: ID does not exist" containerID="2763b7e071dd545d72507fe5d42184708ba171252bff032232611094edb38d2f" Oct 30 22:37:18.326015 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.325957 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2763b7e071dd545d72507fe5d42184708ba171252bff032232611094edb38d2f"} err="failed to get container status \"2763b7e071dd545d72507fe5d42184708ba171252bff032232611094edb38d2f\": rpc error: code = NotFound desc = could not find container \"2763b7e071dd545d72507fe5d42184708ba171252bff032232611094edb38d2f\": container with ID starting with 2763b7e071dd545d72507fe5d42184708ba171252bff032232611094edb38d2f not found: ID does not exist" Oct 30 22:37:18.326015 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.325984 4497 scope.go:122] "RemoveContainer" containerID="b6c65fa5463526aa8b91441bea3f872dab1419c60792c4b546c981d920e2b942" Oct 30 22:37:18.326278 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:37:18.326256 4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6c65fa5463526aa8b91441bea3f872dab1419c60792c4b546c981d920e2b942\": container with ID starting with b6c65fa5463526aa8b91441bea3f872dab1419c60792c4b546c981d920e2b942 not found: ID does not exist" containerID="b6c65fa5463526aa8b91441bea3f872dab1419c60792c4b546c981d920e2b942" Oct 30 22:37:18.326367 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.326288 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6c65fa5463526aa8b91441bea3f872dab1419c60792c4b546c981d920e2b942"} err="failed to get container status \"b6c65fa5463526aa8b91441bea3f872dab1419c60792c4b546c981d920e2b942\": rpc error: code = NotFound desc = could not find container \"b6c65fa5463526aa8b91441bea3f872dab1419c60792c4b546c981d920e2b942\": container with ID starting with b6c65fa5463526aa8b91441bea3f872dab1419c60792c4b546c981d920e2b942 not found: ID does not exist" Oct 30 22:37:18.326367 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.326308 4497 scope.go:122] "RemoveContainer" containerID="2763b7e071dd545d72507fe5d42184708ba171252bff032232611094edb38d2f" Oct 30 22:37:18.326557 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.326536 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2763b7e071dd545d72507fe5d42184708ba171252bff032232611094edb38d2f"} err="failed to get container status \"2763b7e071dd545d72507fe5d42184708ba171252bff032232611094edb38d2f\": rpc error: code = NotFound desc = could not find container \"2763b7e071dd545d72507fe5d42184708ba171252bff032232611094edb38d2f\": container with ID starting with 2763b7e071dd545d72507fe5d42184708ba171252bff032232611094edb38d2f not found: ID does not exist" Oct 30 22:37:18.326607 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.326559 4497 scope.go:122] "RemoveContainer" containerID="b6c65fa5463526aa8b91441bea3f872dab1419c60792c4b546c981d920e2b942" Oct 30 22:37:18.326788 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.326770 4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6c65fa5463526aa8b91441bea3f872dab1419c60792c4b546c981d920e2b942"} err="failed to get container status \"b6c65fa5463526aa8b91441bea3f872dab1419c60792c4b546c981d920e2b942\": rpc error: code = NotFound desc = could not find container \"b6c65fa5463526aa8b91441bea3f872dab1419c60792c4b546c981d920e2b942\": container with ID starting with b6c65fa5463526aa8b91441bea3f872dab1419c60792c4b546c981d920e2b942 not found: ID does not exist" Oct 30 22:37:18.472142 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.472113 4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5"] Oct 30 22:37:18.479648 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:18.479624 4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-959ee2f135/message-dumper-predictor-544ddf8bbb-gcrl5"] Oct 30 22:37:19.538905 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:19.538876 4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a4159464-ebd1-4350-8700-62d9c47d2b49" path="/var/lib/kubelet/pods/a4159464-ebd1-4350-8700-62d9c47d2b49/volumes" Oct 30 22:37:22.134336 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:22.134300 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:23.065278 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:23.065228 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:29.653894 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:37:29.653849 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:37:35.012151 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:35.012114 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:46.508434 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:46.508353 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:50.462750 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:50.462713 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:50.791162 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:50.791060 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:52.685416 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:52.685374 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:52.973382 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:37:52.973287 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:59.653572 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:37:59.653535 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:38:22.526755 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:38:22.526712 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:38:29.652999 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:38:29.652954 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:38:59.654000 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:38:59.653962 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:39:01.599216 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:39:01.599179 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:39:12.329257 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:39:12.329219 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:39:12.652433 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:39:12.652402 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:39:22.774450 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:39:22.774414 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:39:29.654162 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:39:29.654118 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:39:59.653212 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:39:59.653175 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:40:03.962205 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:40:03.962168 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:40:17.762947 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:40:17.762913 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:40:22.355679 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:40:22.355640 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:40:22.673927 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:40:22.673891 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:40:23.145687 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:40:23.145658 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:40:29.654369 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:40:29.654331 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:40:53.889367 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:40:53.889280 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:40:59.653548 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:40:59.653513 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:41:02.466402 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:41:02.466359 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:41:02.741186 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:41:02.741099 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:41:23.475795 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:41:23.475756 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:41:29.654112 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:41:29.654070 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:41:59.653719 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:41:59.653684 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:42:09.169954 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:42:09.169862 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:42:13.725567 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:42:13.725529 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:42:14.077298 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:42:14.077214 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:42:23.801093 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:42:23.801051 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:42:29.656067 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:42:29.656028 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:42:33.809729 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:42:33.809692 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:42:42.384971 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:42:42.384926 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:42:42.742172 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:42:42.742087 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:42:59.652903 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:42:59.652867 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:43:24.154665 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:43:24.154634 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:43:29.653286 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:43:29.653232 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:43:33.400504 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:43:33.400465 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:43:59.653615 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:43:59.653535 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:44:06.502811 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:44:06.502776 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:44:06.786382 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:44:06.786290 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:44:24.506228 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:44:24.506191 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:44:29.652868 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:44:29.652831 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:44:47.797938 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:44:47.797900 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:44:59.653908 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:44:59.653873 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:45:20.666455 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:45:20.666412 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:45:20.921331 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:45:20.921221 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:45:23.457856 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:45:23.457817 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:45:24.074042 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:45:24.074004 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:45:24.839498 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:45:24.839451 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:45:29.653894 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:45:29.653857 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:45:59.653473 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:45:59.653437 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:46:01.538942 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:46:01.538904 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:46:06.092674 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:46:06.092634 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:46:06.393683 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:46:06.393655 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:46:09.028963 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:46:09.028928 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:46:09.285604 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:46:09.285521 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:46:12.192558 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:46:12.192517 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:46:25.228288 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:46:25.228232 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:46:25.489777 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:46:25.489687 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:46:29.654011 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:46:29.653968 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:46:59.653351 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:46:59.653264 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:47:25.579751 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:47:25.579718 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:47:29.653119 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:47:29.653083 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:47:44.049084 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:47:44.049040 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:47:50.335221 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:47:50.335184 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:47:50.765771 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:47:50.765737 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:47:59.653417 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:47:59.653371 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:48:02.868534 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:48:02.868494 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:48:07.482411 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:48:07.482313 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:48:07.746289 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:48:07.746188 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:48:25.938488 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:48:25.938442 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:48:29.654212 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:48:29.654174 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:48:59.653632 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:48:59.653587 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:49:03.933404 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:49:03.933364 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:49:08.704024 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:49:08.703991 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:49:09.009995 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:49:09.009893 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:49:26.283972 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:49:26.283939 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:49:26.557713 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:49:26.557629 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:49:29.653753 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:49:29.653714 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:49:41.623444 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:49:41.623335 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:49:48.162658 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:49:48.162617 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:49:48.479064 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:49:48.479021 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:49:49.822347 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:49:49.822314 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:49:54.256489 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:49:54.256447 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:49:54.525714 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:49:54.525631 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:49:54.818858 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:49:54.818763 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:49:55.082805 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:49:55.082720 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:49:59.653460 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:49:59.653427 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:50:26.654014 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:50:26.653972 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:50:29.654180 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:50:29.654142 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:50:38.811531 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:50:38.811490 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:50:49.418996 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:50:49.418947 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:50:49.742431 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:50:49.742340 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:50:59.653573 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:50:59.653537 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:51:26.969354 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:51:26.969267 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:51:29.652616 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:51:29.652580 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:51:34.902386 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:51:34.902352 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:51:35.224017 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:51:35.223925 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:51:40.079083 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:51:40.079046 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:51:43.493918 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:51:43.493881 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:51:43.756624 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:51:43.756523 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:51:44.023789 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:51:44.023691 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:51:44.305416 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:51:44.305328 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:51:50.628335 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:51:50.628302 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:51:50.949089 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:51:50.948998 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:51:59.654007 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:51:59.653970 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:52:27.353811 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:52:27.353769 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:52:27.659755 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:52:27.659715 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:52:29.653879 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:52:29.653845 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:52:59.653607 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:52:59.653566 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:53:11.820216 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:53:11.820174 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:53:13.813025 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:53:13.812991 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:53:18.056411 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:53:18.056379 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:53:20.403687 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:53:20.403647 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:53:20.673715 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:53:20.673626 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:53:27.661160 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:53:27.661124 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:53:29.653035 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:53:29.653000 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:53:59.653433 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:53:59.653395 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:54:20.986622 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:54:20.986532 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:54:28.016116 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:54:28.016082 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:54:29.653696 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:54:29.653654 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:54:31.680487 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:54:31.680450 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:54:31.977401 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:54:31.977305 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:54:44.564311 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:54:44.564265 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:54:53.180309 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:54:53.180270 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:54:53.452554 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:54:53.452461 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:54:53.727649 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:54:53.727559 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:54:54.002630 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:54:54.002537 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:54:59.654063 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:54:59.654026 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:55:28.369430 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:55:28.369385 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:55:29.653910 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:55:29.653873 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:55:53.089452 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:55:53.089406 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:55:59.651918 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:55:59.651882 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:56:01.943231 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:56:01.943194 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:56:02.220854 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:56:02.220772 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:56:28.715346 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:56:28.715312 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:56:29.398712 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:56:29.398678 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:56:29.654162 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:56:29.654077 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:56:45.473600 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:56:45.473565 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:56:59.654396 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:56:59.654360 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:57:23.081862 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:57:23.081777 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:57:29.050726 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:57:29.050688 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:57:29.655930 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:57:29.655892 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:57:29.767844 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:57:29.767808 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:57:30.088407 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:57:30.088327 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:57:59.140581 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:57:59.140541 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:57:59.653220 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:57:59.653185 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:58:07.798293 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:58:07.798249 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:58:08.113723 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:58:08.113637 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:58:08.450832 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:58:08.450791 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:58:08.717433 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:58:08.717336 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:58:29.394908 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:58:29.394863 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:58:29.653303 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:58:29.653210 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:58:59.653409 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:58:59.653371 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:59:00.013426 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:59:00.013353 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:59:02.399016 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:59:02.398981 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:59:02.705322 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:59:02.705220 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:59:12.292099 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:59:12.292055 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:59:16.187188 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:59:16.187152 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:59:16.487978 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:59:16.487889 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:59:29.653891 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:59:29.653853 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 22:59:29.802429 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:59:29.802395 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:59:47.757887 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:59:47.757835 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:59:48.304576 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:59:48.304545 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:59:56.077446 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:59:56.077411 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:59:56.349420 ip-10-0-129-150 kubenswrapper[4497]: I1030 22:59:56.349329 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 22:59:59.653978 ip-10-0-129-150 kubenswrapper[4497]: E1030 22:59:59.653939 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:00:29.653618 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:00:29.653530 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:00:30.094525 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:00:30.094438 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:00:32.102064 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:00:32.102028 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:00:35.448902 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:00:35.448865 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:00:46.529298 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:00:46.529259 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:00:48.786775 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:00:48.786687 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:00:49.101902 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:00:49.101813 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:00:59.027569 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:00:59.027515 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:00:59.653333 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:00:59.653300 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:01:03.538733 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:01:03.538693 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:01:03.805275 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:01:03.805164 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:01:29.653406 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:01:29.653367 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:01:30.437114 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:01:30.437078 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:01:59.001228 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:01:59.001189 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:01:59.653772 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:01:59.653739 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:02:06.208300 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:02:06.208259 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:02:06.522437 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:02:06.522341 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:02:09.882892 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:02:09.882850 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:02:29.653803 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:02:29.653765 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:02:30.784768 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:02:30.784729 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:02:33.980881 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:02:33.980840 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:02:36.113481 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:02:36.113452 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:02:36.389136 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:02:36.389099 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:02:56.416555 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:02:56.416505 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:02:59.654364 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:02:59.654317 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:03:00.903429 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:03:00.903388 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:03:01.150193 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:03:01.150156 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:03:29.653562 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:03:29.653522 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:03:31.130540 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:03:31.130497 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:03:33.306096 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:03:33.306037 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:03:59.653183 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:03:59.653145 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:04:00.240036 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:04:00.239987 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:04:08.743783 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:04:08.743735 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:04:09.115095 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:04:09.114995 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:04:23.066015 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:04:23.065970 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:04:29.572796 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:04:29.572764 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:04:29.653904 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:04:29.653873 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:04:29.889833 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:04:29.889802 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:04:31.462398 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:04:31.462365 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:04:33.623908 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:04:33.623877 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:04:59.520530 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:04:59.520498 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:04:59.654341 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:04:59.654309 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:05:04.023416 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:05:04.023378 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:05:04.331295 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:05:04.331191 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:05:29.654434 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:05:29.654396 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:05:31.813820 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:05:31.813782 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:05:44.767153 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:05:44.767114 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:05:46.253389 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:05:46.253349 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:05:49.193345 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:05:49.193300 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:05:49.466360 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:05:49.466267 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:05:54.083203 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:05:54.083155 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:05:54.378696 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:05:54.378658 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:05:59.653590 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:05:59.653546 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:06:03.465296 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:06:03.465263 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:06:29.653339 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:06:29.653226 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:06:32.166916 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:06:32.166855 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:06:39.859407 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:06:39.859367 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:06:44.361599 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:06:44.361561 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:06:44.685522 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:06:44.685486 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:06:55.482816 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:06:55.482773 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:06:59.653758 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:06:59.653722 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:07:01.996709 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:07:01.996677 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:07:02.278459 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:07:02.278377 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:07:29.655973 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:07:29.655934 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:07:32.572420 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:07:32.572386 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:07:37.364571 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:07:37.364475 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:07:37.633768 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:07:37.633734 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:07:59.653135 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:07:59.653097 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:08:04.769598 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:08:04.769556 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:08:29.656869 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:08:29.656742 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:08:32.910636 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:08:32.910592 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:08:37.728205 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:08:37.728167 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:08:39.068656 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:08:39.068618 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:08:44.389421 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:08:44.389385 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:08:49.502019 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:08:49.501981 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:08:59.652488 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:08:59.652456 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:09:00.503474 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:09:00.503433 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:09:00.877796 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:09:00.877754 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:09:29.655423 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:09:29.655384 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:09:32.885933 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:09:32.885895 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:09:33.200211 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:09:33.200115 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:09:33.507972 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:09:33.507875 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:09:59.653299 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:09:59.653260 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:10:20.275335 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:10:20.275300 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:10:25.074485 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:10:25.074436 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:10:26.708686 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:10:26.708647 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:10:27.024798 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:10:27.024709 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:10:29.653334 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:10:29.653293 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:10:33.552044 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:10:33.552003 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:10:37.004722 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:10:37.004633 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:10:37.267085 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:10:37.267003 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:10:59.656989 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:10:59.656951 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:11:29.655334 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:11:29.655298 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:11:33.940204 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:11:33.940162 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:11:42.911755 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:11:42.911720 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:11:43.236194 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:11:43.236107 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:11:49.173691 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:11:49.173651 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:11:49.448542 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:11:49.448453 4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" limit=1024 Oct 30 23:11:53.472515 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:11:53.472474 4497 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ztkhr_1a5f581d-cc10-4cb5-bba9-0ff5b78fb7be/global-pull-secret-syncer/0.log" Oct 30 23:11:55.541539 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:11:55.541511 4497 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cqphm_f20cb0c1-6f52-41e1-978d-f59baf6bab48/konnectivity-agent/0.log" Oct 30 23:11:57.024290 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:11:57.024260 4497 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-150.us-west-1.compute.internal_b1d3741bfbe7d5cade012c8699af4bf8/haproxy/0.log" Oct 30 23:11:59.656682 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:11:59.656639 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor" Oct 30 23:12:05.968082 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:05.968051 4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24"] Oct 30 23:12:05.968564 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:05.968325 4497 cpu_manager.go:414] "containerMap: removing container" podUID="a4159464-ebd1-4350-8700-62d9c47d2b49" containerName="kube-rbac-proxy" Oct 30 23:12:05.968564 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:05.968337 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a4159464-ebd1-4350-8700-62d9c47d2b49" containerName="kube-rbac-proxy" Oct 30 23:12:05.968564 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:05.968350 4497 cpu_manager.go:414] "containerMap: removing container" podUID="a4159464-ebd1-4350-8700-62d9c47d2b49" containerName="kserve-container" Oct 30 23:12:05.968564 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:05.968355 4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a4159464-ebd1-4350-8700-62d9c47d2b49" containerName="kserve-container" Oct 30 23:12:05.968564 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:05.968406 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="a4159464-ebd1-4350-8700-62d9c47d2b49" containerName="kube-rbac-proxy" Oct 30 23:12:05.968564 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:05.968414 4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="a4159464-ebd1-4350-8700-62d9c47d2b49" containerName="kserve-container" Oct 30 23:12:05.971295 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:05.971255 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" Oct 30 23:12:06.025787 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.025764 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dk65g\"/\"kube-root-ca.crt\"" Oct 30 23:12:06.074700 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.074675 4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dk65g\"/\"openshift-service-ca.crt\"" Oct 30 23:12:06.074818 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.074745 4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dk65g\"/\"default-dockercfg-w2m2f\"" Oct 30 23:12:06.074878 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.074855 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00b9592e-7e40-49c9-a621-fec1f0ae39c4-sys\") pod \"perf-node-gather-daemonset-c8c24\" (UID: \"00b9592e-7e40-49c9-a621-fec1f0ae39c4\") " pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" Oct 30 23:12:06.074931 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.074889 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00b9592e-7e40-49c9-a621-fec1f0ae39c4-lib-modules\") pod \"perf-node-gather-daemonset-c8c24\" (UID: \"00b9592e-7e40-49c9-a621-fec1f0ae39c4\") " pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" Oct 30 23:12:06.074986 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.074939 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/00b9592e-7e40-49c9-a621-fec1f0ae39c4-proc\") pod \"perf-node-gather-daemonset-c8c24\" (UID: \"00b9592e-7e40-49c9-a621-fec1f0ae39c4\") " pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" Oct 30 23:12:06.075040 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.074981 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trdwt\" (UniqueName: \"kubernetes.io/projected/00b9592e-7e40-49c9-a621-fec1f0ae39c4-kube-api-access-trdwt\") pod \"perf-node-gather-daemonset-c8c24\" (UID: \"00b9592e-7e40-49c9-a621-fec1f0ae39c4\") " pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" Oct 30 23:12:06.075040 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.075010 4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/00b9592e-7e40-49c9-a621-fec1f0ae39c4-podres\") pod \"perf-node-gather-daemonset-c8c24\" (UID: \"00b9592e-7e40-49c9-a621-fec1f0ae39c4\") " pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" Oct 30 23:12:06.075983 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.075959 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24"] Oct 30 23:12:06.176096 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.176068 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00b9592e-7e40-49c9-a621-fec1f0ae39c4-sys\") pod \"perf-node-gather-daemonset-c8c24\" (UID: \"00b9592e-7e40-49c9-a621-fec1f0ae39c4\") " pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" Oct 30 23:12:06.176204 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.176105 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00b9592e-7e40-49c9-a621-fec1f0ae39c4-lib-modules\") pod \"perf-node-gather-daemonset-c8c24\" (UID: \"00b9592e-7e40-49c9-a621-fec1f0ae39c4\") " pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" Oct 30 23:12:06.176204 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.176125 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/00b9592e-7e40-49c9-a621-fec1f0ae39c4-proc\") pod \"perf-node-gather-daemonset-c8c24\" (UID: \"00b9592e-7e40-49c9-a621-fec1f0ae39c4\") " pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" Oct 30 23:12:06.176204 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.176150 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trdwt\" (UniqueName: \"kubernetes.io/projected/00b9592e-7e40-49c9-a621-fec1f0ae39c4-kube-api-access-trdwt\") pod \"perf-node-gather-daemonset-c8c24\" (UID: \"00b9592e-7e40-49c9-a621-fec1f0ae39c4\") " pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" Oct 30 23:12:06.176204 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.176174 4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/00b9592e-7e40-49c9-a621-fec1f0ae39c4-podres\") pod \"perf-node-gather-daemonset-c8c24\" (UID: \"00b9592e-7e40-49c9-a621-fec1f0ae39c4\") " pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" Oct 30 23:12:06.176204 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.176178 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00b9592e-7e40-49c9-a621-fec1f0ae39c4-sys\") pod \"perf-node-gather-daemonset-c8c24\" (UID: \"00b9592e-7e40-49c9-a621-fec1f0ae39c4\") " pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" Oct 30 23:12:06.176415 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.176199 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00b9592e-7e40-49c9-a621-fec1f0ae39c4-lib-modules\") pod \"perf-node-gather-daemonset-c8c24\" (UID: \"00b9592e-7e40-49c9-a621-fec1f0ae39c4\") " pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" Oct 30 23:12:06.176415 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.176259 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/00b9592e-7e40-49c9-a621-fec1f0ae39c4-podres\") pod \"perf-node-gather-daemonset-c8c24\" (UID: \"00b9592e-7e40-49c9-a621-fec1f0ae39c4\") " pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" Oct 30 23:12:06.176415 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.176263 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/00b9592e-7e40-49c9-a621-fec1f0ae39c4-proc\") pod \"perf-node-gather-daemonset-c8c24\" (UID: \"00b9592e-7e40-49c9-a621-fec1f0ae39c4\") " pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" Oct 30 23:12:06.239112 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.239059 4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trdwt\" (UniqueName: \"kubernetes.io/projected/00b9592e-7e40-49c9-a621-fec1f0ae39c4-kube-api-access-trdwt\") pod \"perf-node-gather-daemonset-c8c24\" (UID: \"00b9592e-7e40-49c9-a621-fec1f0ae39c4\") " pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" Oct 30 23:12:06.283128 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.283103 4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" Oct 30 23:12:06.652294 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:06.652271 4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24"] Oct 30 23:12:06.654834 ip-10-0-129-150 kubenswrapper[4497]: W1030 23:12:06.654804 4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod00b9592e_7e40_49c9_a621_fec1f0ae39c4.slice/crio-5b5f5bb05bfc8910090f92f88a47650753c323266994fe1ed2d3478b8e876092 WatchSource:0}: Error finding container 5b5f5bb05bfc8910090f92f88a47650753c323266994fe1ed2d3478b8e876092: Status 404 returned error can't find the container with id 5b5f5bb05bfc8910090f92f88a47650753c323266994fe1ed2d3478b8e876092 Oct 30 23:12:07.013634 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:07.013553 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" event={"ID":"00b9592e-7e40-49c9-a621-fec1f0ae39c4","Type":"ContainerStarted","Data":"a038a4084f5819f8c76f4e4516fbbe655c569aa5efd5c602f59ce382959ed267"} Oct 30 23:12:07.013634 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:07.013610 4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" event={"ID":"00b9592e-7e40-49c9-a621-fec1f0ae39c4","Type":"ContainerStarted","Data":"5b5f5bb05bfc8910090f92f88a47650753c323266994fe1ed2d3478b8e876092"} Oct 30 23:12:07.014004 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:07.013690 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" Oct 30 23:12:07.131629 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:07.131579 4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" podStartSLOduration=2.131564239 podStartE2EDuration="2.131564239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:12:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:12:07.130884718 +0000 UTC m=+3821.757950267" watchObservedRunningTime="2026-10-30 23:12:07.131564239 +0000 UTC m=+3821.758629791" Oct 30 23:12:07.472181 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:07.472157 4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-brbdv_6f8697db-185a-496e-a21a-2d56e33297b9/node-exporter/0.log" Oct 30 23:12:07.894222 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:07.894191 4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-brbdv_6f8697db-185a-496e-a21a-2d56e33297b9/kube-rbac-proxy/0.log" Oct 30 23:12:08.310688 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:08.310620 4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-brbdv_6f8697db-185a-496e-a21a-2d56e33297b9/init-textfile/0.log" Oct 30 23:12:13.027896 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:13.027859 4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dk65g/perf-node-gather-daemonset-c8c24" Oct 30 23:12:16.293827 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:16.293799 4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-6bgp8_b05c998f-4a64-44b5-85b6-490fdc1ce6c5/prometheus-operator-admission-webhook/0.log" Oct 30 23:12:28.019191 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:28.019164 4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5995f846-n4sng_06e4ca34-03e1-47dc-9f46-04ffb9b110d0/console/0.log" Oct 30 23:12:28.467965 ip-10-0-129-150 kubenswrapper[4497]: I1030 23:12:28.467929 4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6dd789c8b7-48xkh_d205edc5-f396-4209-ab4e-9c337c54ae57/download-server/0.log" Oct 30 23:12:29.656829 ip-10-0-129-150 kubenswrapper[4497]: E1030 23:12:29.656774 4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nf65g" containerName="extractor"