Oct 30 02:55:00.283298 ip-10-0-139-40 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 02:55:00.641853 ip-10-0-139-40 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 02:55:00.641853 ip-10-0-139-40 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 02:55:00.641853 ip-10-0-139-40 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 02:55:00.641853 ip-10-0-139-40 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 02:55:00.646134 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.645966    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:00.646234 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646221    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:00.646352 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646234    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:00.646352 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646240    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:00.646352 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646244    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:00.646352 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646249    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:00.646352 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646253    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:00.646352 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646257    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:00.646352 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646261    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:00.646352 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646266    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:00.646352 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646269    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:00.646352 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646273    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:00.646352 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646277    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:00.646352 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646281    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:00.646352 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646285    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:00.646352 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646289    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:00.646352 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646294    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:00.646352 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646300    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:00.646352 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646304    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:00.646352 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646308    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:00.646352 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646312    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:00.646793 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646316    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:00.646793 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646320    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:00.646793 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646325    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:00.646793 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646329    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:00.646793 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646334    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:00.646793 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646339    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:00.646793 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646343    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:00.646793 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646348    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:00.646793 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646352    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:00.646793 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646357    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:00.646793 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646362    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:00.646793 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646368    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:00.646793 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646372    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:00.646793 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646376    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:00.646793 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646380    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:00.646793 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646385    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:00.646793 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646391    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:00.646793 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646395    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:00.646793 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646398    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:00.647270 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646400    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:00.647270 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646403    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:00.647270 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646406    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:00.647270 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646408    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:00.647270 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646411    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:00.647270 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646414    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:00.647270 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646416    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:00.647270 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646419    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:00.647270 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646422    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:00.647270 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646424    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:00.647270 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646427    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:00.647270 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646430    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:00.647270 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646432    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:00.647270 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646435    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:00.647270 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646438    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:00.647270 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646441    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:00.647270 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646443    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:00.647270 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646446    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:00.647270 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646448    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:00.647270 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646451    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:00.647737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646454    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:00.647737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646457    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:00.647737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646460    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:00.647737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646463    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:00.647737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646466    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:00.647737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646468    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:00.647737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646471    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:00.647737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646473    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:00.647737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646476    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:00.647737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646479    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:00.647737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646482    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:00.647737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646484    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:00.647737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646487    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:00.647737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646489    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:00.647737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646492    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:00.647737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646494    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:00.647737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646497    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:00.647737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646500    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:00.647737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646502    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:00.647737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646505    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:00.648218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646507    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:00.648218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646510    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:00.648218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646512    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:00.648218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646516    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:00.648218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646519    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:00.648218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646521    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:00.648218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646525    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:00.648218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646528    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:00.648218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646530    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:00.648218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646533    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:00.648218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646535    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:00.648218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646538    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:00.648218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646541    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:00.648218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646543    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:00.648218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646546    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:00.648218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646549    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:00.648218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646552    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:00.648218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646554    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:00.648218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646557    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:00.648218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646559    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:00.648717 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646562    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:00.648717 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646565    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:00.648717 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646567    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:00.648717 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646570    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:00.648717 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646575    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:00.648717 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.646580    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:00.648717 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647376    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:00.648717 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647384    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:00.648717 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647387    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:00.648717 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647390    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:00.648717 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647393    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:00.648717 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647395    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:00.648717 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647399    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:00.648717 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647401    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:00.648717 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647404    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:00.648717 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647406    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:00.648717 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647410    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:00.648717 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647413    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:00.648717 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647416    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:00.649218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647419    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:00.649218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647421    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:00.649218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647424    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:00.649218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647427    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:00.649218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647430    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:00.649218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647432    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:00.649218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647435    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:00.649218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647438    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:00.649218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647441    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:00.649218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647443    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:00.649218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647446    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:00.649218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647448    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:00.649218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647451    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:00.649218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647454    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:00.649218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647456    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:00.649218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647459    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:00.649218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647462    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:00.649218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647464    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:00.649218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647467    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:00.649663 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647469    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:00.649663 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647472    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:00.649663 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647475    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:00.649663 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647477    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:00.649663 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647479    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:00.649663 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647482    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:00.649663 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647484    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:00.649663 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647487    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:00.649663 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647489    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:00.649663 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647492    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:00.649663 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647494    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:00.649663 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647497    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:00.649663 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647500    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:00.649663 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647503    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:00.649663 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647505    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:00.649663 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647508    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:00.649663 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647511    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:00.649663 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647514    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:00.649663 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647516    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:00.649663 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647519    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:00.650158 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647521    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:00.650158 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647523    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:00.650158 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647528    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:00.650158 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647532    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:00.650158 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647535    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:00.650158 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647537    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:00.650158 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647540    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:00.650158 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647543    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:00.650158 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647545    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:00.650158 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647548    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:00.650158 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647550    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:00.650158 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647552    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:00.650158 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647555    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:00.650158 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647557    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:00.650158 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647560    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:00.650158 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647562    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:00.650158 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647565    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:00.650158 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647567    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:00.650624 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647570    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:00.650624 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647573    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:00.650624 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647576    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:00.650624 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647578    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:00.650624 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647581    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:00.650624 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647584    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:00.650624 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647587    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:00.650624 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647590    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:00.650624 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647592    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:00.650624 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647595    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:00.650624 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647597    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:00.650624 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647601    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:00.650624 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647605    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:00.650624 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647608    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:00.650624 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647611    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:00.650624 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647613    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:00.650624 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647616    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:00.650624 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647619    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:00.650624 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647621    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:00.651095 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647624    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:00.651095 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647627    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:00.651095 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647629    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:00.651095 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647631    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:00.651095 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647634    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:00.651095 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647637    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:00.651095 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647639    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:00.651095 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647642    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:00.651095 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647645    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:00.651095 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647650    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:00.651095 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647653    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:00.651095 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647655    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:00.651095 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647658    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:00.651095 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647664    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:00.651095 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647667    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:00.651095 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647670    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:00.651095 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.647672    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:00.651095 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648234    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:00.651095 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648241    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:00.651095 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648245    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:00.651579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648248    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:00.651579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648251    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:00.651579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648254    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:00.651579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648257    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:00.651579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648259    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:00.651579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648262    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:00.651579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648264    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:00.651579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648267    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:00.651579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648270    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:00.651579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648272    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:00.651579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648275    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:00.651579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648277    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:00.651579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648280    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:00.651579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648283    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:00.651579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648285    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:00.651579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648287    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:00.651579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648290    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:00.651579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648292    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:00.651579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648295    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:00.652035 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648297    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:00.652035 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648300    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:00.652035 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648303    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:00.652035 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648306    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:00.652035 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648308    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:00.652035 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648311    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:00.652035 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648313    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:00.652035 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648316    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:00.652035 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648318    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:00.652035 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648321    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:00.652035 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648323    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:00.652035 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648326    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:00.652035 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648329    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:00.652035 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648332    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:00.652035 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648334    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:00.652035 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648337    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:00.652035 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648341    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:00.652035 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648345    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:00.652035 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648348    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:00.652483 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648350    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:00.652483 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648353    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:00.652483 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648356    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:00.652483 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648359    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:00.652483 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648361    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:00.652483 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648364    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:00.652483 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648367    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:00.652483 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648369    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:00.652483 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648372    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:00.652483 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648374    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:00.652483 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648377    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:00.652483 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648379    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:00.652483 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648382    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:00.652483 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648384    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:00.652483 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648387    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:00.652483 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648390    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:00.652483 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648392    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:00.652483 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648396    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:00.652483 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648401    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:00.652932 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648404    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:00.652932 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648406    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:00.652932 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648409    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:00.652932 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648412    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:00.652932 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648414    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:00.652932 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648417    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:00.652932 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648420    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:00.652932 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648422    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:00.652932 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648428    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:00.652932 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648431    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:00.652932 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648434    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:00.652932 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648436    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:00.652932 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648439    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:00.652932 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648441    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:00.652932 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648444    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:00.652932 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648446    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:00.652932 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648449    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:00.652932 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648451    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:00.652932 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648454    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:00.652932 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648456    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:00.653406 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648459    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:00.653406 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648461    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:00.653406 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648464    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:00.653406 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648467    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:00.653406 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648469    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:00.653406 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648472    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:00.653406 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648474    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:00.653406 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648476    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:00.653406 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648479    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:00.653406 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648482    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:00.653406 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648485    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:00.653406 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648487    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:00.653406 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648490    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:00.653406 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648492    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:00.653406 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648495    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:00.653406 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648497    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:00.653406 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648500    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:00.653406 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648503    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:00.653406 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648505    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648508    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648511    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648515    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648518    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648521    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648523    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.648526    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649355    2576 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649367    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649374    2576 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649379    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649384    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649387    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649391    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649395    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649398    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649402    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649405    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649409    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649412    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649415    2576 flags.go:64] FLAG: --cgroup-root=""
Oct 30 02:55:00.653847 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649418    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649420    2576 flags.go:64] FLAG: --client-ca-file=""
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649423    2576 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649426    2576 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649429    2576 flags.go:64] FLAG: --cluster-domain=""
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649432    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649435    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649439    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649442    2576 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649447    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649450    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649453    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649457    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649460    2576 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649464    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649467    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649470    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649473    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649482    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649485    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649488    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649491    2576 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649494    2576 flags.go:64] FLAG: --enable-server="true"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649497    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649501    2576 flags.go:64] FLAG: --event-burst="100"
Oct 30 02:55:00.654383 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649504    2576 flags.go:64] FLAG: --event-qps="50"
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649507    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649512    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649515    2576 flags.go:64] FLAG: --eviction-hard=""
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649519    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649522    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649526    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649529    2576 flags.go:64] FLAG: --eviction-soft=""
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649532    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649535    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649538    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649541    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649544    2576 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649547    2576 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649550    2576 flags.go:64] FLAG: --feature-gates=""
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649555    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649558    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649561    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649565    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649568    2576 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649571    2576 flags.go:64] FLAG: --help="false"
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649574    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-139-40.ec2.internal"
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649577    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649580    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 02:55:00.655042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649583    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649587    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649590    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649593    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649596    2576 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649599    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649602    2576 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649604    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649608    2576 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649610    2576 flags.go:64] FLAG: --kube-reserved=""
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649615    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649618    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649621    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649624    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649627    2576 flags.go:64] FLAG: --lock-file=""
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649629    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649632    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649635    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649641    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649644    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649647    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649650    2576 flags.go:64] FLAG: --logging-format="text"
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649653    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649658    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 02:55:00.655627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649661    2576 flags.go:64] FLAG: --manifest-url=""
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649664    2576 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649669    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649672    2576 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649676    2576 flags.go:64] FLAG: --max-pods="110"
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649679    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649682    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649686    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649689    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649692    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649695    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649698    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649704    2576 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649707    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649710    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649713    2576 flags.go:64] FLAG: --pod-cidr=""
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649716    2576 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649719    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649723    2576 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649726    2576 flags.go:64] FLAG: --port="10250"
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649729    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649733    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01cacd1ebcb333035"
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649736    2576 flags.go:64] FLAG: --qos-reserved=""
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649739    2576 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649742    2576 flags.go:64] FLAG: --register-node="true"
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649745    2576 flags.go:64] FLAG: --register-with-taints=""
Oct 30 02:55:00.656240 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649749    2576 flags.go:64] FLAG: --registry-burst="10"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649752    2576 flags.go:64] FLAG: --registry-qps="5"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649755    2576 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649757    2576 flags.go:64] FLAG: --reserved-memory=""
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649762    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649766    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649769    2576 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649772    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649775    2576 flags.go:64] FLAG: --runonce="false"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649780    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649784    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649789    2576 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649793    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649798    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649802    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649805    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649808    2576 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649811    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649814    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649817    2576 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649820    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649823    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649826    2576 flags.go:64] FLAG: --system-cgroups=""
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649828    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649835    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 02:55:00.656851 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649838    2576 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649840    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649845    2576 flags.go:64] FLAG: --tls-min-version=""
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649847    2576 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649850    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649853    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649856    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649859    2576 flags.go:64] FLAG: --v="2"
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649863    2576 flags.go:64] FLAG: --version="false"
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649867    2576 flags.go:64] FLAG: --vmodule=""
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649871    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.649874    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650035    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650040    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650043    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650045    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650048    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650051    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650054    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650056    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650059    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650061    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650065    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:00.657448 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650068    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:00.657981 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650070    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:00.657981 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650073    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:00.657981 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650075    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:00.657981 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650078    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:00.657981 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650080    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:00.657981 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650084    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:00.657981 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650086    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:00.657981 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650090    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:00.657981 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650093    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:00.657981 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650095    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:00.657981 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650098    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:00.657981 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650101    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:00.657981 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650103    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:00.657981 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650106    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:00.657981 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650109    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:00.657981 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650111    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:00.657981 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650114    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:00.657981 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650117    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:00.657981 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650119    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:00.657981 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650122    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:00.658471 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650125    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:00.658471 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650128    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:00.658471 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650130    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:00.658471 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650133    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:00.658471 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650136    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:00.658471 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650138    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:00.658471 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650141    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:00.658471 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650143    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:00.658471 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650146    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:00.658471 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650149    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:00.658471 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650153    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:00.658471 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650157    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:00.658471 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650160    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:00.658471 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650162    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:00.658471 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650165    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:00.658471 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650168    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:00.658471 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650171    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:00.658471 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650173    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:00.658471 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650176    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:00.658471 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650180    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:00.658944 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650182    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:00.658944 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650185    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:00.658944 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650187    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:00.658944 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650190    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:00.658944 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650192    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:00.658944 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650195    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:00.658944 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650197    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:00.658944 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650200    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:00.658944 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650202    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:00.658944 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650205    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:00.658944 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650208    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:00.658944 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650211    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:00.658944 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650213    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:00.658944 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650216    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:00.658944 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650218    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:00.658944 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650221    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:00.658944 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650224    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:00.658944 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650226    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:00.658944 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650229    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:00.658944 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650231    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:00.659472 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650233    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:00.659472 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650236    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:00.659472 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650238    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:00.659472 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650241    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:00.659472 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650244    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:00.659472 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650247    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:00.659472 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650249    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:00.659472 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650252    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:00.659472 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650254    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:00.659472 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650257    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:00.659472 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650259    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:00.659472 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650263    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:00.659472 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650265    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:00.659472 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650268    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:00.659472 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650270    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:00.659472 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650273    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:00.659472 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650276    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:00.659472 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650278    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:00.659898 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650282    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:00.659898 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650286    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:00.659898 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650289    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:00.659898 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650292    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:00.659898 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650296    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:00.659898 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650298    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:00.659898 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650303    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:00.659898 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650306    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:00.659898 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650309    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:00.659898 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650311    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:00.659898 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650314    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:00.659898 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650316    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:00.659898 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650319    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:00.659898 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650321    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:00.659898 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650324    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:00.659898 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650327    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:00.660283 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.650353    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 02:55:00.660283 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650405    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:00.660283 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650410    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:00.660283 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650413    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:00.660283 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650416    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:00.660283 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650419    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:00.660283 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650421    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:00.660283 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650424    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:00.660283 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650427    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:00.660283 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650429    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:00.660283 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650433    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:00.660283 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650435    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:00.660283 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650438    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:00.660283 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650441    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:00.660283 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650443    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:00.660283 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650446    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:00.660662 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650448    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:00.660662 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650451    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:00.660662 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650454    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:00.660662 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650456    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:00.660662 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650459    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:00.660662 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650461    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:00.660662 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650465    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:00.660662 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650468    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:00.660662 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650471    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:00.660662 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650474    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:00.660662 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650476    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:00.660662 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650479    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:00.660662 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650481    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:00.660662 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650484    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:00.660662 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650486    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:00.660662 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650489    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:00.660662 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650492    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:00.660662 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650494    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:00.660662 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650497    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:00.660662 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650499    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:00.661144 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650502    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:00.661144 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650505    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:00.661144 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650508    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:00.661144 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650510    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:00.661144 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650513    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:00.661144 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650515    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:00.661144 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650520    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:00.661144 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650522    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:00.661144 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650525    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:00.661144 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650528    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:00.661144 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650530    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:00.661144 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650533    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:00.661144 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650535    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:00.661144 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650540    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:00.661144 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650543    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:00.661144 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650546    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:00.661144 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650549    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:00.661144 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650551    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:00.661144 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650555    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:00.661144 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650558    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:00.661659 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650561    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:00.661659 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650563    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:00.661659 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650565    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:00.661659 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650568    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:00.661659 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650571    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:00.661659 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650573    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:00.661659 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650576    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:00.661659 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650579    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:00.661659 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650581    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:00.661659 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650584    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:00.661659 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650586    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:00.661659 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650588    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:00.661659 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650591    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:00.661659 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650594    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:00.661659 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650597    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:00.661659 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650599    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:00.661659 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650602    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:00.661659 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650604    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:00.661659 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650608    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:00.661659 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650610    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:00.662143 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650613    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:00.662143 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650616    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:00.662143 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650618    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:00.662143 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650621    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:00.662143 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650624    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:00.662143 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650626    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:00.662143 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650629    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:00.662143 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650632    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:00.662143 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650634    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:00.662143 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650637    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:00.662143 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650641    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:00.662143 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650644    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:00.662143 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650646    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:00.662143 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650649    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:00.662143 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650652    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:00.662143 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650654    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:00.662143 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650657    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:00.662143 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650659    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:00.662143 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650662    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:00.662680 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650665    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:00.662680 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650667    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:00.662680 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650672    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:00.662680 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650675    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:00.662680 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650678    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:00.662680 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650681    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:00.662680 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650683    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:00.662680 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650687    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:00.662680 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650689    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:00.662680 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650692    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:00.662680 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650694    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:00.662680 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.650698    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:00.662680 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.657727    2576 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 02:55:00.662680 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.657744    2576 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 02:55:00.662680 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.657761    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 02:55:00.662680 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.657766    2576 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 02:55:00.662680 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657821    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:00.662680 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657827    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:00.662680 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657830    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:00.663325 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657833    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:00.663325 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657836    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:00.663325 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657839    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:00.663325 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657842    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:00.663325 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657845    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:00.663325 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657847    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:00.663325 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657850    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:00.663325 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657853    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:00.663325 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657856    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:00.663325 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657860    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:00.663325 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657863    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:00.663325 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657866    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:00.663325 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657869    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:00.663325 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657872    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:00.663325 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657874    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:00.663325 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657877    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:00.663325 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657880    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:00.663325 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657882    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:00.663325 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657885    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:00.663806 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657887    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:00.663806 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657890    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:00.663806 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657894    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:00.663806 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657898    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:00.663806 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657902    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:00.663806 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657905    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:00.663806 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657908    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:00.663806 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657912    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:00.663806 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657915    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:00.663806 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657918    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:00.663806 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657921    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:00.663806 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657923    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:00.663806 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657926    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:00.663806 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657928    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:00.663806 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657931    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:00.663806 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657934    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:00.663806 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657936    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:00.663806 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657939    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:00.663806 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657942    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:00.664579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657945    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:00.664579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657947    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:00.664579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657950    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:00.664579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657953    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:00.664579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657956    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:00.664579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657958    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:00.664579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657961    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:00.664579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657964    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:00.664579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657967    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:00.664579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657969    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:00.664579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657972    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:00.664579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657974    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:00.664579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657977    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:00.664579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657979    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:00.664579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657982    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:00.664579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657985    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:00.664579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657988    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:00.664579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657990    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:00.664579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657993    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:00.664579 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657996    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:00.665246 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.657999    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:00.665246 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658002    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:00.665246 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658005    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:00.665246 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658008    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:00.665246 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658027    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:00.665246 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658030    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:00.665246 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658033    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:00.665246 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658035    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:00.665246 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658038    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:00.665246 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658041    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:00.665246 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658044    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:00.665246 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658046    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:00.665246 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658049    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:00.665246 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658051    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:00.665246 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658054    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:00.665246 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658057    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:00.665246 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658059    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:00.665246 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658062    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:00.665246 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658064    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:00.665762 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658067    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:00.665762 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658069    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:00.665762 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658072    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:00.665762 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658074    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:00.665762 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658077    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:00.665762 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658079    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:00.665762 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658082    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:00.665762 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658084    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:00.665762 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658087    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:00.665762 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658090    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:00.665762 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658093    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:00.665762 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658095    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:00.665762 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658098    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:00.665762 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658101    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:00.665762 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658104    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:00.665762 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658107    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:00.665762 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658110    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:00.665762 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658112    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:00.665762 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658115    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:00.665762 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658118    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:00.666254 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658120    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:00.666254 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658123    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:00.666254 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658125    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:00.666254 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658128    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:00.666254 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658130    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:00.666254 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658132    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:00.666254 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.658161    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 02:55:00.666254 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658315    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:00.666254 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658321    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:00.666254 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658324    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:00.666254 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658327    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:00.666254 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658329    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:00.666254 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658332    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:00.666254 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658334    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:00.666254 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658337    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:00.666254 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658339    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:00.666254 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658342    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:00.666841 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658344    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:00.666841 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658347    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:00.666841 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658350    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:00.666841 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658352    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:00.666841 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658355    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:00.666841 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658357    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:00.666841 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658360    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:00.666841 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658363    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:00.666841 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658365    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:00.666841 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658368    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:00.666841 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658370    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:00.666841 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658374    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:00.666841 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658376    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:00.666841 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658379    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:00.666841 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658381    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:00.666841 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658384    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:00.666841 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658386    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:00.666841 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658389    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:00.666841 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658391    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:00.667333 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658394    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:00.667333 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658396    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:00.667333 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658398    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:00.667333 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658401    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:00.667333 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658404    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:00.667333 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658406    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:00.667333 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658408    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:00.667333 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658412    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:00.667333 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658416    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:00.667333 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658419    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:00.667333 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658421    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:00.667333 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658424    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:00.667333 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658426    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:00.667333 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658429    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:00.667333 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658431    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:00.667333 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658434    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:00.667333 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658437    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:00.667333 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658439    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:00.667333 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658442    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:00.667794 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658444    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:00.667794 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658447    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:00.667794 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658450    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:00.667794 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658452    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:00.667794 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658455    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:00.667794 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658457    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:00.667794 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658460    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:00.667794 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658463    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:00.667794 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658465    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:00.667794 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658468    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:00.667794 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658470    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:00.667794 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658473    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:00.667794 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658476    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:00.667794 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658478    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:00.667794 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658481    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:00.667794 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658484    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:00.667794 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658486    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:00.667794 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658489    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:00.667794 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658491    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:00.667794 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658494    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:00.668282 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658496    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:00.668282 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658499    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:00.668282 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658501    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:00.668282 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658504    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:00.668282 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658506    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:00.668282 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658509    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:00.668282 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658512    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:00.668282 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658514    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:00.668282 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658517    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:00.668282 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658519    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:00.668282 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658522    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:00.668282 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658524    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:00.668282 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658527    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:00.668282 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658529    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:00.668282 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658532    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:00.668282 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658534    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:00.668282 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658537    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:00.668282 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658539    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:00.668282 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658544    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:00.668282 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658548    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:00.668785 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658550    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:00.668785 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658553    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:00.668785 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658556    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:00.668785 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658558    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:00.668785 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658561    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:00.668785 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658563    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:00.668785 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658566    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:00.668785 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658568    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:00.668785 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658571    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:00.668785 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658573    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:00.668785 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658576    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:00.668785 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658578    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:00.668785 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658581    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:00.668785 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658583    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:00.668785 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658586    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:00.668785 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658588    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:00.668785 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658591    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:00.668785 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658594    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:00.669223 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.658615    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 02:55:00.669223 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658644    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:00.669223 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658648    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:00.669223 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658651    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:00.669223 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658653    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:00.669223 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658656    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:00.669223 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658658    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:00.669223 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658661    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:00.669223 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658663    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:00.669223 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658666    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:00.669223 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658669    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:00.669223 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658671    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:00.669223 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658674    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:00.669223 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658677    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:00.669223 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658680    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:00.669223 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658682    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:00.669648 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658685    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:00.669648 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658687    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:00.669648 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658690    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:00.669648 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658695    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:00.669648 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658698    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:00.669648 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658700    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:00.669648 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658703    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:00.669648 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658706    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:00.669648 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658708    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:00.669648 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658711    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:00.669648 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658714    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:00.669648 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658716    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:00.669648 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658719    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:00.669648 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658721    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:00.669648 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658724    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:00.669648 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658726    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:00.669648 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658729    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:00.669648 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658731    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:00.669648 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658734    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:00.669648 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658736    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:00.670218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658739    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:00.670218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658742    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:00.670218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658744    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:00.670218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658747    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:00.670218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658749    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:00.670218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658752    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:00.670218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658755    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:00.670218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658757    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:00.670218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658759    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:00.670218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658762    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:00.670218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658764    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:00.670218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658767    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:00.670218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658770    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:00.670218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658772    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:00.670218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658775    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:00.670218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658780    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:00.670218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658784    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:00.670218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658787    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:00.670218 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658789    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:00.670907 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658792    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:00.670907 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658795    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:00.670907 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658797    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:00.670907 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658800    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:00.670907 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658803    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:00.670907 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658805    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:00.670907 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658808    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:00.670907 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658810    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:00.670907 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658813    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:00.670907 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658816    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:00.670907 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658818    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:00.670907 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658821    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:00.670907 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658824    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:00.670907 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658826    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:00.670907 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658829    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:00.670907 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658832    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:00.670907 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658834    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:00.670907 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658837    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:00.670907 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658839    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:00.670907 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658842    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:00.671707 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658844    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:00.671707 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658847    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:00.671707 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658849    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:00.671707 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658852    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:00.671707 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658854    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:00.671707 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658858    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:00.671707 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658860    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:00.671707 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658863    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:00.671707 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658867    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:00.671707 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658869    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:00.671707 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658872    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:00.671707 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658875    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:00.671707 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658879    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:00.671707 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658881    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:00.671707 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658884    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:00.671707 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658887    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:00.671707 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658889    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:00.671707 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658892    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:00.671707 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658895    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:00.671707 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658897    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:00.672222 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658900    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:00.672222 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658902    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:00.672222 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658905    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:00.672222 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658907    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:00.672222 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658910    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:00.672222 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658913    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:00.672222 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658919    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:00.672222 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658923    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:00.672222 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658926    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:00.672222 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658929    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:00.672222 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658931    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:00.672222 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:00.658934    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:00.672222 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.658987    2576 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 02:55:00.672222 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.661254    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 02:55:00.672222 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.662180    2576 server.go:1014] "Starting client certificate rotation"
Oct 30 02:55:00.672222 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.662290    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 02:55:00.672222 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.662978    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 02:55:00.672665 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.663946    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 02:55:00.672665 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.665037    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 02:55:00.678841 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.678825    2576 log.go:25] "Validated CRI v1 runtime API"
Oct 30 02:55:00.682135 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.682121    2576 log.go:25] "Validated CRI v1 image API"
Oct 30 02:55:00.682957 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.682935    2576 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 02:55:00.685297 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.685279    2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 838d8d87-71a7-4bc6-af02-65fd3f3049ba:/dev/nvme0n1p4 ea5950d7-d8c6-47d8-a672-fc662b04c21a:/dev/nvme0n1p3]
Oct 30 02:55:00.685352 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.685297    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 02:55:00.690198 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.690093    2576 manager.go:217] Machine: {Timestamp:2026-10-30 02:55:00.688842262 +0000 UTC m=+0.300023733 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098934 MemoryCapacity:33164328960 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b45d7edd49f66be2ac07ca26d3c5f SystemUUID:ec2b45d7-edd4-9f66-be2a-c07ca26d3c5f BootID:34cff740-0b33-4c27-8380-88d23d53f8f0 Filesystems:[{Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582164480 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c8:4b:26:83 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c8:4b:26:83 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:10:10:d4:ac:bf Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164328960 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 02:55:00.690276 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.690200    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 02:55:00.690306 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.690274    2576 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 02:55:00.693237 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.693105    2576 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 02:55:00.693366 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.693241    2576 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-40.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 02:55:00.693420 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.693369    2576 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 02:55:00.693420 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.693377    2576 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 02:55:00.693474 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.693427    2576 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 02:55:00.693474 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.693446    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 02:55:00.694439 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.694429    2576 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 02:55:00.698377 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.698364    2576 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 02:55:00.698491 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.698481    2576 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 02:55:00.699151 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.699136    2576 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 02:55:00.699181 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.699158    2576 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 02:55:00.699181 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.699167    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 02:55:00.699181 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.699176    2576 kubelet.go:405] "Adding apiserver pod source"
Oct 30 02:55:00.699295 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.699184    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 02:55:00.699480 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.699467    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 02:55:00.701540 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.701524    2576 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 02:55:00.707611 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.707598    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 02:55:00.708413 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.708401    2576 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 02:55:00.708455 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.708431    2576 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 02:55:00.708571 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.708561    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 02:55:00.708601 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.708576    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 02:55:00.708601 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.708582    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 02:55:00.708601 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.708588    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 02:55:00.708601 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.708594    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 02:55:00.708601 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.708599    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 02:55:00.709264 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.709256    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 02:55:00.709299 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.709265    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 02:55:00.709299 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.709283    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 02:55:00.709299 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.709290    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 02:55:00.709373 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.709303    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 02:55:00.709373 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.709311    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 02:55:00.710662 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.710653    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 02:55:00.710662 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.710662    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 02:55:00.714492 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.714478    2576 server.go:1263] "Started kubelet"
Oct 30 02:55:00.714577 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.714549    2576 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 02:55:00.714794 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.714698    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 02:55:00.714794 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.714754    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 02:55:00.715390 ip-10-0-139-40 systemd[1]: Started Kubernetes Kubelet.
Oct 30 02:55:00.718312 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.717956    2576 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 02:55:00.722048 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.722032    2576 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 02:55:00.722253 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:00.722235    2576 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 02:55:00.724745 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.724726    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 02:55:00.725844 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.725829    2576 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 02:55:00.725976 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:00.725953    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-40.ec2.internal\" not found"
Oct 30 02:55:00.726636 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.726457    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 02:55:00.726636 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.726469    2576 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 02:55:00.726636 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.726483    2576 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 02:55:00.726636 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.726603    2576 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 02:55:00.726636 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.726614    2576 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 02:55:00.726636 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.726604    2576 factory.go:55] Registering systemd factory
Oct 30 02:55:00.726636 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.726635    2576 factory.go:223] Registration of the systemd container factory successfully
Oct 30 02:55:00.726880 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.726818    2576 factory.go:153] Registering CRI-O factory
Oct 30 02:55:00.726880 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.726826    2576 factory.go:223] Registration of the crio container factory successfully
Oct 30 02:55:00.726880 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.726870    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 02:55:00.726958 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.726884    2576 factory.go:103] Registering Raw factory
Oct 30 02:55:00.726958 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.726894    2576 manager.go:1199] Started watching for new ooms in manager
Oct 30 02:55:00.727755 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.727733    2576 manager.go:319] Starting recovery of all containers
Oct 30 02:55:00.734949 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.734913    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 02:55:00.737636 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.737617    2576 manager.go:324] Recovery completed
Oct 30 02:55:00.743131 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.743116    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:55:00.745083 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.745058    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:55:00.745152 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.745098    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:55:00.745152 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.745113    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:55:00.745646 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.745631    2576 cpu_manager.go:226] "Starting" policy="none"
Oct 30 02:55:00.745646 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.745643    2576 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 02:55:00.745750 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.745661    2576 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 02:55:00.745750 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.745679    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:55:00.746609 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.746582    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-40.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 02:55:00.746958 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:00.746934    2576 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-40.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 02:55:00.748054 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.748005    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:55:00.748142 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.748078    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:55:00.748142 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.748102    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:55:00.748233 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:00.747265    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-40.ec2.internal.18e32f223c86c384  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-40.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-40.ec2.internal,},FirstTimestamp:2026-10-30 02:55:00.714447748 +0000 UTC m=+0.325629219,LastTimestamp:2026-10-30 02:55:00.714447748 +0000 UTC m=+0.325629219,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-40.ec2.internal,}"
Oct 30 02:55:00.749898 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.749882    2576 policy_none.go:50] "Start"
Oct 30 02:55:00.749970 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.749901    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 02:55:00.749970 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.749920    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 02:55:00.751991 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.751975    2576 policy_none.go:44] "Start"
Oct 30 02:55:00.764483 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:00.764450    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 30 02:55:00.764574 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:00.764502    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 30 02:55:00.764574 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:00.764507    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-40.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 30 02:55:00.764772 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:00.764709    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-40.ec2.internal.18e32f223e5a357c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-40.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-40.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-40.ec2.internal,},FirstTimestamp:2026-10-30 02:55:00.745082236 +0000 UTC m=+0.356263706,LastTimestamp:2026-10-30 02:55:00.745082236 +0000 UTC m=+0.356263706,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-40.ec2.internal,}"
Oct 30 02:55:00.807104 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.785164    2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 02:55:00.807104 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.788735    2576 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 02:55:00.807104 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.791473    2576 manager.go:341] "Starting Device Plugin manager"
Oct 30 02:55:00.807104 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:00.791495    2576 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 02:55:00.807104 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.791503    2576 server.go:87] "Starting device plugin registration server"
Oct 30 02:55:00.807104 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.791791    2576 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 02:55:00.807104 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.791799    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 02:55:00.807104 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.791952    2576 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 02:55:00.807104 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.792042    2576 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 02:55:00.807104 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.792049    2576 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 02:55:00.807104 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:00.792528    2576 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 02:55:00.807104 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:00.792573    2576 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-40.ec2.internal\" not found"
Oct 30 02:55:00.807104 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:00.792685    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-40.ec2.internal.18e32f223e5a9a2d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-40.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-40.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-40.ec2.internal,},FirstTimestamp:2026-10-30 02:55:00.745108013 +0000 UTC m=+0.356289483,LastTimestamp:2026-10-30 02:55:00.745108013 +0000 UTC m=+0.356289483,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-40.ec2.internal,}"
Oct 30 02:55:00.807104 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.800381    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 02:55:00.807104 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.800402    2576 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 02:55:00.807104 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.800418    2576 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 02:55:00.807104 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:00.800446    2576 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 02:55:00.807104 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.804982    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wzb6g"
Oct 30 02:55:00.815510 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.815493    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wzb6g"
Oct 30 02:55:00.819937 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:00.819839    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-40.ec2.internal.18e32f223e5abd13  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-40.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-40.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-40.ec2.internal,},FirstTimestamp:2026-10-30 02:55:00.745116947 +0000 UTC m=+0.356298416,LastTimestamp:2026-10-30 02:55:00.745116947 +0000 UTC m=+0.356298416,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-40.ec2.internal,}"
Oct 30 02:55:00.849787 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.849767    2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:55:00.892469 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.892398    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:55:00.893252 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.893238    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:55:00.893324 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.893264    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:55:00.893324 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.893278    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:55:00.893324 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.893313    2576 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-139-40.ec2.internal"
Oct 30 02:55:00.901408 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.901391    2576 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-40.ec2.internal"]
Oct 30 02:55:00.901476 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.901442    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:55:00.902203 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.902190    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:55:00.902275 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.902215    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:55:00.902275 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.902225    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:55:00.904408 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.904396    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:55:00.904571 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.904557    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:00.904621 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.904611    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:55:00.905029 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.905002    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:55:00.905122 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.905039    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:55:00.905122 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.905055    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:55:00.905263 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.905238    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:55:00.905364 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.905271    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:55:00.905364 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.905286    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:55:00.907210 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.907192    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:00.907301 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.907223    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:55:00.907950 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.907934    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:55:00.908007 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.907965    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:55:00.908007 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.907978    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:55:00.913842 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:00.913828    2576 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-139-40.ec2.internal"
Oct 30 02:55:00.913914 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:00.913846    2576 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-40.ec2.internal\": node \"ip-10-0-139-40.ec2.internal\" not found"
Oct 30 02:55:00.931617 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:00.931599    2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-40.ec2.internal\" not found" node="ip-10-0-139-40.ec2.internal"
Oct 30 02:55:00.933986 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:00.933972    2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-40.ec2.internal\" not found" node="ip-10-0-139-40.ec2.internal"
Oct 30 02:55:00.961629 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:00.961610    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-40.ec2.internal\" not found"
Oct 30 02:55:01.028083 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:01.028057    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13718fab620286fdb285c77e4037fd98-config\") pod \"kube-apiserver-proxy-ip-10-0-139-40.ec2.internal\" (UID: \"13718fab620286fdb285c77e4037fd98\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:01.028176 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:01.028088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1e8aeea066a252cd4be40281f35c3f01-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal\" (UID: \"1e8aeea066a252cd4be40281f35c3f01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:01.028176 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:01.028113    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e8aeea066a252cd4be40281f35c3f01-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal\" (UID: \"1e8aeea066a252cd4be40281f35c3f01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:01.062008 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:01.061987    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-40.ec2.internal\" not found"
Oct 30 02:55:01.129027 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:01.128989    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1e8aeea066a252cd4be40281f35c3f01-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal\" (UID: \"1e8aeea066a252cd4be40281f35c3f01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:01.129129 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:01.129030    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e8aeea066a252cd4be40281f35c3f01-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal\" (UID: \"1e8aeea066a252cd4be40281f35c3f01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:01.129129 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:01.129056    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13718fab620286fdb285c77e4037fd98-config\") pod \"kube-apiserver-proxy-ip-10-0-139-40.ec2.internal\" (UID: \"13718fab620286fdb285c77e4037fd98\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:01.129129 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:01.129103    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e8aeea066a252cd4be40281f35c3f01-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal\" (UID: \"1e8aeea066a252cd4be40281f35c3f01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:01.129129 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:01.129103    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13718fab620286fdb285c77e4037fd98-config\") pod \"kube-apiserver-proxy-ip-10-0-139-40.ec2.internal\" (UID: \"13718fab620286fdb285c77e4037fd98\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:01.129265 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:01.129104    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1e8aeea066a252cd4be40281f35c3f01-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal\" (UID: \"1e8aeea066a252cd4be40281f35c3f01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:01.162945 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:01.162874    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-40.ec2.internal\" not found"
Oct 30 02:55:01.235404 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:01.235375    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:01.237550 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:01.237531    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:01.263841 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:01.263816    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-40.ec2.internal\" not found"
Oct 30 02:55:01.363911 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:01.363883    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-40.ec2.internal\" not found"
Oct 30 02:55:01.464566 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:01.464499    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-40.ec2.internal\" not found"
Oct 30 02:55:01.564975 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:01.564945    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-40.ec2.internal\" not found"
Oct 30 02:55:01.662471 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:01.662442    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 02:55:01.663135 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:01.662598    2576 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 02:55:01.665717 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:01.665689    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-40.ec2.internal\" not found"
Oct 30 02:55:02.824330 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:02.824144    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-40.ec2.internal\" not found"
Oct 30 02:55:02.840918 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:02.840878    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13718fab620286fdb285c77e4037fd98.slice/crio-86839444e77438014c85f53a8092c7ecbe477e631c2e6af015d7e2488be31ee4 WatchSource:0}: Error finding container 86839444e77438014c85f53a8092c7ecbe477e631c2e6af015d7e2488be31ee4: Status 404 returned error can't find the container with id 86839444e77438014c85f53a8092c7ecbe477e631c2e6af015d7e2488be31ee4
Oct 30 02:55:02.841465 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:02.841444    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e8aeea066a252cd4be40281f35c3f01.slice/crio-54be5e07d8720fe6aa36a70fc66f11286429e336b21da6f6087d0c203d29f802 WatchSource:0}: Error finding container 54be5e07d8720fe6aa36a70fc66f11286429e336b21da6f6087d0c203d29f802: Status 404 returned error can't find the container with id 54be5e07d8720fe6aa36a70fc66f11286429e336b21da6f6087d0c203d29f802
Oct 30 02:55:02.846112 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:02.846093    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 02:55:02.859131 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:02.859107    2576 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:55:02.862323 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:02.862283    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-40.ec2.internal" event={"ID":"13718fab620286fdb285c77e4037fd98","Type":"ContainerStarted","Data":"86839444e77438014c85f53a8092c7ecbe477e631c2e6af015d7e2488be31ee4"}
Oct 30 02:55:02.863213 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:02.863190    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal" event={"ID":"1e8aeea066a252cd4be40281f35c3f01","Type":"ContainerStarted","Data":"54be5e07d8720fe6aa36a70fc66f11286429e336b21da6f6087d0c203d29f802"}
Oct 30 02:55:02.878598 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:02.878565    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 02:50:01 +0000 UTC" deadline="2028-07-03 13:41:30.850489626 +0000 UTC"
Oct 30 02:55:02.878676 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:02.878599    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14698h46m27.971895365s"
Oct 30 02:55:02.925228 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:02.925208    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-40.ec2.internal\" not found"
Oct 30 02:55:02.961370 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:02.961351    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:55:02.962404 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:02.962389    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:55:02.962480 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:02.962421    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:55:02.962480 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:02.962436    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:55:03.025643 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:03.025623    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-40.ec2.internal\" not found"
Oct 30 02:55:03.126215 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:03.126194    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-40.ec2.internal\" not found"
Oct 30 02:55:03.225944 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.225912    2576 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:55:03.226932 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:03.226905    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-40.ec2.internal\" not found"
Oct 30 02:55:03.278022 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.277989    2576 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:55:03.283966 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.283944    2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:03.330400 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.330378    2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 02:55:03.331443 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.331420    2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:03.352282 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.352264    2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 02:55:03.757856 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.757817    2576 apiserver.go:52] "Watching apiserver"
Oct 30 02:55:03.783725 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.783700    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 02:55:03.797994 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.797972    2576 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 02:55:03.798366 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.798345    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-7jm4j","openshift-cluster-node-tuning-operator/tuned-w29gr","openshift-dns/node-resolver-ttjnv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal","openshift-network-diagnostics/network-check-target-p7mkl","openshift-network-operator/iptables-alerter-twcgj","kube-system/kube-apiserver-proxy-ip-10-0-139-40.ec2.internal","openshift-image-registry/node-ca-s8pxs","kube-system/global-pull-secret-syncer-lg4vm","openshift-multus/multus-additional-cni-plugins-r6frn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5","openshift-multus/multus-cvsmc","openshift-multus/network-metrics-daemon-zxzxk","openshift-ovn-kubernetes/ovnkube-node-rpbtg"]
Oct 30 02:55:03.801090 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.801067    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s8pxs"
Oct 30 02:55:03.803496 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.803474    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.805534 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.805512    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:03.805700 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:03.805598    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxzxk" podUID="e7a138e6-2485-4134-9d3a-c2419d154f30"
Oct 30 02:55:03.807741 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.807719    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:03.810079 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.809958    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ttjnv"
Oct 30 02:55:03.812634 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.812158    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7jm4j"
Oct 30 02:55:03.814455 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.814353    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:03.814455 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:03.814418    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7mkl" podUID="46ab1416-b4cf-4b29-b8b3-38fdf77db001"
Oct 30 02:55:03.817711 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.816146    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 02:55:03.817711 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.816206    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 02:55:03.817711 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.816213    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 02:55:03.817711 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.816377    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5kvz4\""
Oct 30 02:55:03.817711 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.816954    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-twcgj"
Oct 30 02:55:03.819454 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.818167    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 02:55:03.819454 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.818244    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 02:55:03.819454 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.818261    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 02:55:03.819454 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.818362    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-65dst\""
Oct 30 02:55:03.819454 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.819006    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.819974 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.819958    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 02:55:03.821863 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.821842    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:03.821950 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:03.821911    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4vm" podUID="f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc"
Oct 30 02:55:03.824000 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.823979    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:03.826680 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.826619    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:03.830513 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.830489    2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 02:55:03.830602 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.830549    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x54vf"
Oct 30 02:55:03.844014 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.843995    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x54vf"
Oct 30 02:55:03.885077 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.885059    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 02:55:03.894966 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.894944    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67e06851-bb40-4be7-87dd-36b84f182f8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:03.895073 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.894972    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-socket-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:03.895073 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.894989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2-serviceca\") pod \"node-ca-s8pxs\" (UID: \"dec5346e-cd73-40b5-bcf4-05bc1a7e33e2\") " pod="openshift-image-registry/node-ca-s8pxs"
Oct 30 02:55:03.895073 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-cnibin\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.895223 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895125    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-daemon-config\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.895223 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895154    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmgxl\" (UniqueName: \"kubernetes.io/projected/e7a138e6-2485-4134-9d3a-c2419d154f30-kube-api-access-wmgxl\") pod \"network-metrics-daemon-zxzxk\" (UID: \"e7a138e6-2485-4134-9d3a-c2419d154f30\") " pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:03.895223 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895194    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/207f380c-c390-48c7-8df5-2d828b166284-etc-tuned\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:03.895327 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895259    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drz2l\" (UniqueName: \"kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l\") pod \"network-check-target-p7mkl\" (UID: \"46ab1416-b4cf-4b29-b8b3-38fdf77db001\") " pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:03.895327 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2-host\") pod \"node-ca-s8pxs\" (UID: \"dec5346e-cd73-40b5-bcf4-05bc1a7e33e2\") " pod="openshift-image-registry/node-ca-s8pxs"
Oct 30 02:55:03.895327 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895324    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2pmx\" (UniqueName: \"kubernetes.io/projected/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887-kube-api-access-q2pmx\") pod \"iptables-alerter-twcgj\" (UID: \"bd1c3b69-f5f0-415e-a4a1-2be07d7d1887\") " pod="openshift-network-operator/iptables-alerter-twcgj"
Oct 30 02:55:03.895439 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895374    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-kubelet-config\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:03.895439 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895408    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3bbb4629-dd25-4dae-b2a0-be0099cacaeb-konnectivity-ca\") pod \"konnectivity-agent-7jm4j\" (UID: \"3bbb4629-dd25-4dae-b2a0-be0099cacaeb\") " pod="kube-system/konnectivity-agent-7jm4j"
Oct 30 02:55:03.895510 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895434    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-run-openvswitch\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.895510 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895472    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-node-log\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.895578 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895508    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-modprobe-d\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:03.895578 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895539    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-run\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:03.895578 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895564    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/322fa146-852c-4aca-a334-e9ba4e23d8ad-tmp-dir\") pod \"node-resolver-ttjnv\" (UID: \"322fa146-852c-4aca-a334-e9ba4e23d8ad\") " pod="openshift-dns/node-resolver-ttjnv"
Oct 30 02:55:03.895725 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895579    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3bbb4629-dd25-4dae-b2a0-be0099cacaeb-agent-certs\") pod \"konnectivity-agent-7jm4j\" (UID: \"3bbb4629-dd25-4dae-b2a0-be0099cacaeb\") " pod="kube-system/konnectivity-agent-7jm4j"
Oct 30 02:55:03.895725 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895639    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67e06851-bb40-4be7-87dd-36b84f182f8c-system-cni-dir\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:03.895725 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895673    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-cni-dir\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.895861 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895721    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-sys\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:03.895861 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895750    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-cni-bin\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.895861 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895795    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-cni-netd\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.895861 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895823    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-var-lib-kubelet\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.895861 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895840    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4aa93acd-52e0-4abe-ab94-12c4b3105126-ovnkube-config\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.895861 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895854    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:03.896096 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-socket-dir-parent\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.896096 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895930    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-run-netns\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.896096 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895960    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887-iptables-alerter-script\") pod \"iptables-alerter-twcgj\" (UID: \"bd1c3b69-f5f0-415e-a4a1-2be07d7d1887\") " pod="openshift-network-operator/iptables-alerter-twcgj"
Oct 30 02:55:03.896096 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.895991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:03.896096 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896011    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4aa93acd-52e0-4abe-ab94-12c4b3105126-env-overrides\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.896096 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896042    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-etc-selinux\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:03.896096 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896076    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-var-lib-cni-bin\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.896298 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896101    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-sysctl-d\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:03.896298 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896116    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-kubelet\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.896298 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896153    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-device-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:03.896298 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896181    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-var-lib-openvswitch\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.896298 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896205    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d4449be-5ad9-45a2-a708-8935ea16fed1-cni-binary-copy\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.896298 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896232    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-run-multus-certs\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.896298 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-kubernetes\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:03.896298 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896285    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-host\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:03.896585 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896317    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4aa93acd-52e0-4abe-ab94-12c4b3105126-ovnkube-script-lib\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.896585 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896335    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs8gw\" (UniqueName: \"kubernetes.io/projected/4aa93acd-52e0-4abe-ab94-12c4b3105126-kube-api-access-zs8gw\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.896585 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896359    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-system-cni-dir\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.896585 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896382    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-sysconfig\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:03.896585 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896407    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-sysctl-conf\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:03.896585 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896443    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-systemd\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:03.896585 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896474    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/322fa146-852c-4aca-a334-e9ba4e23d8ad-hosts-file\") pod \"node-resolver-ttjnv\" (UID: \"322fa146-852c-4aca-a334-e9ba4e23d8ad\") " pod="openshift-dns/node-resolver-ttjnv"
Oct 30 02:55:03.896585 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-sys-fs\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:03.896585 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896564    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-run-netns\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.896974 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896602    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67e06851-bb40-4be7-87dd-36b84f182f8c-cnibin\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:03.896974 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896632    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9frht\" (UniqueName: \"kubernetes.io/projected/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2-kube-api-access-9frht\") pod \"node-ca-s8pxs\" (UID: \"dec5346e-cd73-40b5-bcf4-05bc1a7e33e2\") " pod="openshift-image-registry/node-ca-s8pxs"
Oct 30 02:55:03.896974 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-var-lib-cni-multus\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.896974 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896671    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-hostroot\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.896974 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896703    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-conf-dir\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.896974 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896735    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs\") pod \"network-metrics-daemon-zxzxk\" (UID: \"e7a138e6-2485-4134-9d3a-c2419d154f30\") " pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:03.896974 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896781    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887-host-slash\") pod \"iptables-alerter-twcgj\" (UID: \"bd1c3b69-f5f0-415e-a4a1-2be07d7d1887\") " pod="openshift-network-operator/iptables-alerter-twcgj"
Oct 30 02:55:03.896974 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896828    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-etc-openvswitch\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.896974 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-log-socket\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.896974 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896916    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-lib-modules\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:03.896974 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896942    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-slash\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.897325 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.896977    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-run-ovn-kubernetes\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.897325 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.897023    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67e06851-bb40-4be7-87dd-36b84f182f8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:03.897325 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.897069    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/67e06851-bb40-4be7-87dd-36b84f182f8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:03.897325 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.897126    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/67e06851-bb40-4be7-87dd-36b84f182f8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:03.897325 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.897162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpfxh\" (UniqueName: \"kubernetes.io/projected/67e06851-bb40-4be7-87dd-36b84f182f8c-kube-api-access-cpfxh\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:03.897325 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.897194    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk75k\" (UniqueName: \"kubernetes.io/projected/a707ea73-de7e-406f-89ec-9197a6c0f2b5-kube-api-access-xk75k\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:03.897325 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.897227    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/207f380c-c390-48c7-8df5-2d828b166284-tmp\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:03.897325 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.897261    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-dbus\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:03.897325 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.897299    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-run-systemd\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.897325 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.897323    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4aa93acd-52e0-4abe-ab94-12c4b3105126-ovn-node-metrics-cert\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.897654 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.897360    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-etc-kubernetes\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.897654 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.897428    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnvfv\" (UniqueName: \"kubernetes.io/projected/7d4449be-5ad9-45a2-a708-8935ea16fed1-kube-api-access-pnvfv\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.897654 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.897452    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-var-lib-kubelet\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:03.897654 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.897474    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgxnj\" (UniqueName: \"kubernetes.io/projected/207f380c-c390-48c7-8df5-2d828b166284-kube-api-access-xgxnj\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:03.897654 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.897495    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-run-ovn\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.897654 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.897519    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.897654 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.897544    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-registration-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:03.897654 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.897569    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-run-k8s-cni-cncf-io\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.897654 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.897615    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4mxx\" (UniqueName: \"kubernetes.io/projected/322fa146-852c-4aca-a334-e9ba4e23d8ad-kube-api-access-m4mxx\") pod \"node-resolver-ttjnv\" (UID: \"322fa146-852c-4aca-a334-e9ba4e23d8ad\") " pod="openshift-dns/node-resolver-ttjnv"
Oct 30 02:55:03.897654 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.897638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-systemd-units\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.917789 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.917757    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 02:55:03.918473 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.918455    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pz2d6\""
Oct 30 02:55:03.918579 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.918562    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 02:55:03.918715 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.918668    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 02:55:03.918791 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.918739    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 02:55:03.918903 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.918887    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 02:55:03.918984 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.918952    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 02:55:03.919044 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.919030    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lx7sd\""
Oct 30 02:55:03.919101 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.919059    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 02:55:03.919158 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.919145    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 02:55:03.919241 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.919228    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 02:55:03.919309 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.919297    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 02:55:03.919872 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.919856    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:03.919953 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.919907    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 02:55:03.920013 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.919960    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:03.920049 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.920014    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q5wfc\""
Oct 30 02:55:03.920080 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.920048    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:03.920125 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.920113    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:03.920180 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.920168    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 02:55:03.920248 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.920233    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 02:55:03.929731 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.929715    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 02:55:03.929813 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.929746    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-726c9\""
Oct 30 02:55:03.930384 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.930364    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-vcctk\""
Oct 30 02:55:03.930474 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.930405    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q4rkf\""
Oct 30 02:55:03.930474 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.930412    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 02:55:03.930474 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.930422    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qr586\""
Oct 30 02:55:03.930474 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.930461    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 02:55:03.963337 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.963317    2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:55:03.998406 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998381    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs\") pod \"network-metrics-daemon-zxzxk\" (UID: \"e7a138e6-2485-4134-9d3a-c2419d154f30\") " pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:03.998557 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998415    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887-host-slash\") pod \"iptables-alerter-twcgj\" (UID: \"bd1c3b69-f5f0-415e-a4a1-2be07d7d1887\") " pod="openshift-network-operator/iptables-alerter-twcgj"
Oct 30 02:55:03.998557 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998440    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-etc-openvswitch\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.998557 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998460    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-log-socket\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.998557 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998484    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-lib-modules\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:03.998557 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998505    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-slash\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.998557 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998527    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-run-ovn-kubernetes\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.998557 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998549    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67e06851-bb40-4be7-87dd-36b84f182f8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:03.998906 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998591    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/67e06851-bb40-4be7-87dd-36b84f182f8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:03.998906 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/67e06851-bb40-4be7-87dd-36b84f182f8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:03.998906 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998643    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpfxh\" (UniqueName: \"kubernetes.io/projected/67e06851-bb40-4be7-87dd-36b84f182f8c-kube-api-access-cpfxh\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:03.998906 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998676    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk75k\" (UniqueName: \"kubernetes.io/projected/a707ea73-de7e-406f-89ec-9197a6c0f2b5-kube-api-access-xk75k\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:03.998906 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/207f380c-c390-48c7-8df5-2d828b166284-tmp\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:03.998906 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998751    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-dbus\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:03.998906 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998776    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-run-systemd\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.998906 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998799    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4aa93acd-52e0-4abe-ab94-12c4b3105126-ovn-node-metrics-cert\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.998906 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998806    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-run-ovn-kubernetes\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.998906 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998849    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-etc-kubernetes\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.998906 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998893    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnvfv\" (UniqueName: \"kubernetes.io/projected/7d4449be-5ad9-45a2-a708-8935ea16fed1-kube-api-access-pnvfv\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.999341 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998928    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-var-lib-kubelet\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:03.999341 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998952    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgxnj\" (UniqueName: \"kubernetes.io/projected/207f380c-c390-48c7-8df5-2d828b166284-kube-api-access-xgxnj\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:03.999341 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-run-ovn\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.999341 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.998990    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.999341 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999013    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-registration-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:03.999341 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999060    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-run-k8s-cni-cncf-io\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.999341 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4mxx\" (UniqueName: \"kubernetes.io/projected/322fa146-852c-4aca-a334-e9ba4e23d8ad-kube-api-access-m4mxx\") pod \"node-resolver-ttjnv\" (UID: \"322fa146-852c-4aca-a334-e9ba4e23d8ad\") " pod="openshift-dns/node-resolver-ttjnv"
Oct 30 02:55:03.999341 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999108    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-systemd-units\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:03.999341 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999123    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67e06851-bb40-4be7-87dd-36b84f182f8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:03.999341 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999141    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-socket-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:03.999341 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999158    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2-serviceca\") pod \"node-ca-s8pxs\" (UID: \"dec5346e-cd73-40b5-bcf4-05bc1a7e33e2\") " pod="openshift-image-registry/node-ca-s8pxs"
Oct 30 02:55:03.999341 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999185    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-cnibin\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.999341 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999200    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-daemon-config\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:03.999341 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999216    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmgxl\" (UniqueName: \"kubernetes.io/projected/e7a138e6-2485-4134-9d3a-c2419d154f30-kube-api-access-wmgxl\") pod \"network-metrics-daemon-zxzxk\" (UID: \"e7a138e6-2485-4134-9d3a-c2419d154f30\") " pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:03.999341 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/207f380c-c390-48c7-8df5-2d828b166284-etc-tuned\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:03.999341 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drz2l\" (UniqueName: \"kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l\") pod \"network-check-target-p7mkl\" (UID: \"46ab1416-b4cf-4b29-b8b3-38fdf77db001\") " pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:03.999341 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999294    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2-host\") pod \"node-ca-s8pxs\" (UID: \"dec5346e-cd73-40b5-bcf4-05bc1a7e33e2\") " pod="openshift-image-registry/node-ca-s8pxs"
Oct 30 02:55:04.002121 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2pmx\" (UniqueName: \"kubernetes.io/projected/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887-kube-api-access-q2pmx\") pod \"iptables-alerter-twcgj\" (UID: \"bd1c3b69-f5f0-415e-a4a1-2be07d7d1887\") " pod="openshift-network-operator/iptables-alerter-twcgj"
Oct 30 02:55:04.002121 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999364    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-kubelet-config\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:04.002121 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999389    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3bbb4629-dd25-4dae-b2a0-be0099cacaeb-konnectivity-ca\") pod \"konnectivity-agent-7jm4j\" (UID: \"3bbb4629-dd25-4dae-b2a0-be0099cacaeb\") " pod="kube-system/konnectivity-agent-7jm4j"
Oct 30 02:55:04.002121 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999415    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-run-openvswitch\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.002121 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999439    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-node-log\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.002121 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999473    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-modprobe-d\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.002121 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-run\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.002121 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999491    2576 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 02:55:04.002121 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999519    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/322fa146-852c-4aca-a334-e9ba4e23d8ad-tmp-dir\") pod \"node-resolver-ttjnv\" (UID: \"322fa146-852c-4aca-a334-e9ba4e23d8ad\") " pod="openshift-dns/node-resolver-ttjnv"
Oct 30 02:55:04.002121 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999544    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3bbb4629-dd25-4dae-b2a0-be0099cacaeb-agent-certs\") pod \"konnectivity-agent-7jm4j\" (UID: \"3bbb4629-dd25-4dae-b2a0-be0099cacaeb\") " pod="kube-system/konnectivity-agent-7jm4j"
Oct 30 02:55:04.002121 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999567    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67e06851-bb40-4be7-87dd-36b84f182f8c-system-cni-dir\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:04.002121 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999600    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-cni-dir\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.002121 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999626    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-sys\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.002121 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999646    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-cni-bin\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.002121 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999669    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-cni-netd\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.002121 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999701    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-var-lib-kubelet\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.002121 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999723    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4aa93acd-52e0-4abe-ab94-12c4b3105126-ovnkube-config\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.002121 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:04.002868 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999763    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-socket-dir-parent\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.002868 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999787    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-run-netns\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.002868 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999818    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887-iptables-alerter-script\") pod \"iptables-alerter-twcgj\" (UID: \"bd1c3b69-f5f0-415e-a4a1-2be07d7d1887\") " pod="openshift-network-operator/iptables-alerter-twcgj"
Oct 30 02:55:04.002868 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999831    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-etc-openvswitch\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.002868 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999847    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:04.002868 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999852    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.002868 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999872    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4aa93acd-52e0-4abe-ab94-12c4b3105126-env-overrides\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.002868 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:03.999878    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:55:04.002868 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999898    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-etc-selinux\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:04.002868 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999915    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-log-socket\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.002868 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999925    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-var-lib-cni-bin\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.002868 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999936    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-run\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.002868 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:03.999963    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs podName:e7a138e6-2485-4134-9d3a-c2419d154f30 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:04.499922819 +0000 UTC m=+3.053431036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs") pod "network-metrics-daemon-zxzxk" (UID: "e7a138e6-2485-4134-9d3a-c2419d154f30") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:55:04.002868 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:03.999985    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-registration-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:04.002868 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000021    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-run-k8s-cni-cncf-io\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.002868 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000087    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-lib-modules\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.002868 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000113    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-run-openvswitch\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.003633 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000143    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-var-lib-cni-bin\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.003633 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000160    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-node-log\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.003633 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000203    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-var-lib-kubelet\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.003633 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000280    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-modprobe-d\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.003633 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000318    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887-host-slash\") pod \"iptables-alerter-twcgj\" (UID: \"bd1c3b69-f5f0-415e-a4a1-2be07d7d1887\") " pod="openshift-network-operator/iptables-alerter-twcgj"
Oct 30 02:55:04.003633 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000315    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-slash\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.003633 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000349    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-etc-kubernetes\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.003633 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000373    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-run-ovn\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.003633 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000422    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2-host\") pod \"node-ca-s8pxs\" (UID: \"dec5346e-cd73-40b5-bcf4-05bc1a7e33e2\") " pod="openshift-image-registry/node-ca-s8pxs"
Oct 30 02:55:04.003633 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000426    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-sysctl-d\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.003633 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000453    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67e06851-bb40-4be7-87dd-36b84f182f8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:04.003633 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000462    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-kubelet\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.003633 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000491    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-device-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:04.003633 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000513    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-sysctl-d\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.003633 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000518    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-var-lib-openvswitch\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.003633 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000555    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d4449be-5ad9-45a2-a708-8935ea16fed1-cni-binary-copy\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.003633 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000562    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-var-lib-openvswitch\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.003633 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000556    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-cni-bin\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.004467 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000422    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/322fa146-852c-4aca-a334-e9ba4e23d8ad-tmp-dir\") pod \"node-resolver-ttjnv\" (UID: \"322fa146-852c-4aca-a334-e9ba4e23d8ad\") " pod="openshift-dns/node-resolver-ttjnv"
Oct 30 02:55:04.004467 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000589    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-cni-netd\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.004467 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-run-multus-certs\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.004467 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000515    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-cni-dir\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.004467 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000620    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-kubelet\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.004467 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000465    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67e06851-bb40-4be7-87dd-36b84f182f8c-system-cni-dir\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:04.004467 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000680    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/67e06851-bb40-4be7-87dd-36b84f182f8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:04.004467 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000706    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-kubelet-config\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:04.004467 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000735    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-dbus\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:04.004467 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000744    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-socket-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:04.004467 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000783    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-run-multus-certs\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.004467 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000790    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-run-netns\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.004467 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:04.000854    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 02:55:04.004467 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:04.000899    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret podName:f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc nodeName:}" failed. No retries permitted until 2026-10-30 02:55:04.500882498 +0000 UTC m=+3.054390715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret") pod "global-pull-secret-syncer-lg4vm" (UID: "f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc") : object "kube-system"/"original-pull-secret" not registered
Oct 30 02:55:04.004467 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.000920    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-systemd-units\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.004467 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-kubernetes\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.004467 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001135    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-host\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.005246 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001164    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4aa93acd-52e0-4abe-ab94-12c4b3105126-ovnkube-script-lib\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.005246 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001176    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2-serviceca\") pod \"node-ca-s8pxs\" (UID: \"dec5346e-cd73-40b5-bcf4-05bc1a7e33e2\") " pod="openshift-image-registry/node-ca-s8pxs"
Oct 30 02:55:04.005246 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001191    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs8gw\" (UniqueName: \"kubernetes.io/projected/4aa93acd-52e0-4abe-ab94-12c4b3105126-kube-api-access-zs8gw\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.005246 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001217    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-system-cni-dir\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.005246 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-sysconfig\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.005246 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001270    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-sysctl-conf\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.005246 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001281    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/67e06851-bb40-4be7-87dd-36b84f182f8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:04.005246 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001295    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-systemd\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.005246 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001286    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-daemon-config\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.005246 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001319    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/322fa146-852c-4aca-a334-e9ba4e23d8ad-hosts-file\") pod \"node-resolver-ttjnv\" (UID: \"322fa146-852c-4aca-a334-e9ba4e23d8ad\") " pod="openshift-dns/node-resolver-ttjnv"
Oct 30 02:55:04.005246 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001325    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67e06851-bb40-4be7-87dd-36b84f182f8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:04.005246 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-sys-fs\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:04.005246 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001347    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-var-lib-kubelet\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.005246 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001406    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887-iptables-alerter-script\") pod \"iptables-alerter-twcgj\" (UID: \"bd1c3b69-f5f0-415e-a4a1-2be07d7d1887\") " pod="openshift-network-operator/iptables-alerter-twcgj"
Oct 30 02:55:04.005246 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001408    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-cnibin\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.005246 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001409    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-systemd\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.005246 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001444    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-sysconfig\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.005246 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001461    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-sysctl-conf\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.006101 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001467    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4aa93acd-52e0-4abe-ab94-12c4b3105126-ovnkube-config\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.006101 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001467    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:04.006101 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001481    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-run-systemd\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.006101 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001510    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/322fa146-852c-4aca-a334-e9ba4e23d8ad-hosts-file\") pod \"node-resolver-ttjnv\" (UID: \"322fa146-852c-4aca-a334-e9ba4e23d8ad\") " pod="openshift-dns/node-resolver-ttjnv"
Oct 30 02:55:04.006101 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001513    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-socket-dir-parent\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.006101 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001531    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-sys\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.006101 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001534    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-sys-fs\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:04.006101 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001559    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-device-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:04.006101 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001579    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-etc-selinux\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:04.006101 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001599    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-run-netns\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.006101 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001617    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4aa93acd-52e0-4abe-ab94-12c4b3105126-env-overrides\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.006101 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67e06851-bb40-4be7-87dd-36b84f182f8c-cnibin\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:04.006101 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001636    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-run-netns\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.006101 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001648    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-host\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.006101 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001601    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-system-cni-dir\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.006101 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001655    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9frht\" (UniqueName: \"kubernetes.io/projected/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2-kube-api-access-9frht\") pod \"node-ca-s8pxs\" (UID: \"dec5346e-cd73-40b5-bcf4-05bc1a7e33e2\") " pod="openshift-image-registry/node-ca-s8pxs"
Oct 30 02:55:04.006101 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001776    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-kubernetes\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.006101 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001812    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-var-lib-cni-multus\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.007005 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001841    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-hostroot\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.007005 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001856    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d4449be-5ad9-45a2-a708-8935ea16fed1-cni-binary-copy\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.007005 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001877    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-conf-dir\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.007005 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.001906    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-hostroot\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.007005 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.002074    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-conf-dir\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.007005 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.002117    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-var-lib-cni-multus\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.007005 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.002340    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67e06851-bb40-4be7-87dd-36b84f182f8c-cnibin\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:04.007005 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.003131    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4aa93acd-52e0-4abe-ab94-12c4b3105126-ovnkube-script-lib\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.007005 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.003307    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3bbb4629-dd25-4dae-b2a0-be0099cacaeb-konnectivity-ca\") pod \"konnectivity-agent-7jm4j\" (UID: \"3bbb4629-dd25-4dae-b2a0-be0099cacaeb\") " pod="kube-system/konnectivity-agent-7jm4j"
Oct 30 02:55:04.007005 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.006470    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/207f380c-c390-48c7-8df5-2d828b166284-etc-tuned\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.007437 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.007367    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3bbb4629-dd25-4dae-b2a0-be0099cacaeb-agent-certs\") pod \"konnectivity-agent-7jm4j\" (UID: \"3bbb4629-dd25-4dae-b2a0-be0099cacaeb\") " pod="kube-system/konnectivity-agent-7jm4j"
Oct 30 02:55:04.007514 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.007495    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/207f380c-c390-48c7-8df5-2d828b166284-tmp\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.008204 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.008137    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4aa93acd-52e0-4abe-ab94-12c4b3105126-ovn-node-metrics-cert\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.029130 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:04.029107    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 02:55:04.029130 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:04.029133    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 02:55:04.029276 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:04.029146    2576 projected.go:196] Error preparing data for projected volume kube-api-access-drz2l for pod openshift-network-diagnostics/network-check-target-p7mkl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:55:04.029276 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:04.029210    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l podName:46ab1416-b4cf-4b29-b8b3-38fdf77db001 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:04.529191387 +0000 UTC m=+3.082699616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-drz2l" (UniqueName: "kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l") pod "network-check-target-p7mkl" (UID: "46ab1416-b4cf-4b29-b8b3-38fdf77db001") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:55:04.040217 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.036154    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgxnj\" (UniqueName: \"kubernetes.io/projected/207f380c-c390-48c7-8df5-2d828b166284-kube-api-access-xgxnj\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.040217 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.036575    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4mxx\" (UniqueName: \"kubernetes.io/projected/322fa146-852c-4aca-a334-e9ba4e23d8ad-kube-api-access-m4mxx\") pod \"node-resolver-ttjnv\" (UID: \"322fa146-852c-4aca-a334-e9ba4e23d8ad\") " pod="openshift-dns/node-resolver-ttjnv"
Oct 30 02:55:04.040217 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.036630    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk75k\" (UniqueName: \"kubernetes.io/projected/a707ea73-de7e-406f-89ec-9197a6c0f2b5-kube-api-access-xk75k\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:04.040217 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.037031    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnvfv\" (UniqueName: \"kubernetes.io/projected/7d4449be-5ad9-45a2-a708-8935ea16fed1-kube-api-access-pnvfv\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.040217 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.037073    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmgxl\" (UniqueName: \"kubernetes.io/projected/e7a138e6-2485-4134-9d3a-c2419d154f30-kube-api-access-wmgxl\") pod \"network-metrics-daemon-zxzxk\" (UID: \"e7a138e6-2485-4134-9d3a-c2419d154f30\") " pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:04.040217 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.037447    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2pmx\" (UniqueName: \"kubernetes.io/projected/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887-kube-api-access-q2pmx\") pod \"iptables-alerter-twcgj\" (UID: \"bd1c3b69-f5f0-415e-a4a1-2be07d7d1887\") " pod="openshift-network-operator/iptables-alerter-twcgj"
Oct 30 02:55:04.040217 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.037463    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs8gw\" (UniqueName: \"kubernetes.io/projected/4aa93acd-52e0-4abe-ab94-12c4b3105126-kube-api-access-zs8gw\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.040217 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.037819    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9frht\" (UniqueName: \"kubernetes.io/projected/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2-kube-api-access-9frht\") pod \"node-ca-s8pxs\" (UID: \"dec5346e-cd73-40b5-bcf4-05bc1a7e33e2\") " pod="openshift-image-registry/node-ca-s8pxs"
Oct 30 02:55:04.042205 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.042145    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpfxh\" (UniqueName: \"kubernetes.io/projected/67e06851-bb40-4be7-87dd-36b84f182f8c-kube-api-access-cpfxh\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:04.115766 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.115740    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s8pxs"
Oct 30 02:55:04.123298 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.123270    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:04.125697 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:04.125658    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec5346e_cd73_40b5_bcf4_05bc1a7e33e2.slice/crio-2f28b1ac5fdb018e3800d9e19facff06b608e94d618b8cbf614cf4a102ac4179 WatchSource:0}: Error finding container 2f28b1ac5fdb018e3800d9e19facff06b608e94d618b8cbf614cf4a102ac4179: Status 404 returned error can't find the container with id 2f28b1ac5fdb018e3800d9e19facff06b608e94d618b8cbf614cf4a102ac4179
Oct 30 02:55:04.132908 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.132888    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:04.133229 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:04.133203    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d4449be_5ad9_45a2_a708_8935ea16fed1.slice/crio-a282c6dc95965d366bf89fc39cb76170011e226f46269643466fc13519a91462 WatchSource:0}: Error finding container a282c6dc95965d366bf89fc39cb76170011e226f46269643466fc13519a91462: Status 404 returned error can't find the container with id a282c6dc95965d366bf89fc39cb76170011e226f46269643466fc13519a91462
Oct 30 02:55:04.137859 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.137839    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ttjnv"
Oct 30 02:55:04.145402 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:04.145327    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod207f380c_c390_48c7_8df5_2d828b166284.slice/crio-741cb22141c0b9a04b7127e47ff0f6e2ceba96e893cb4ca929c14a06c88ecc82 WatchSource:0}: Error finding container 741cb22141c0b9a04b7127e47ff0f6e2ceba96e893cb4ca929c14a06c88ecc82: Status 404 returned error can't find the container with id 741cb22141c0b9a04b7127e47ff0f6e2ceba96e893cb4ca929c14a06c88ecc82
Oct 30 02:55:04.145852 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.145837    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7jm4j"
Oct 30 02:55:04.147758 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:04.147739    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod322fa146_852c_4aca_a334_e9ba4e23d8ad.slice/crio-49a9b21ab3550493e45c7862e6578c96e20198340da742eee902e28646cc06e5 WatchSource:0}: Error finding container 49a9b21ab3550493e45c7862e6578c96e20198340da742eee902e28646cc06e5: Status 404 returned error can't find the container with id 49a9b21ab3550493e45c7862e6578c96e20198340da742eee902e28646cc06e5
Oct 30 02:55:04.154273 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.154254    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-twcgj"
Oct 30 02:55:04.157017 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:04.156994    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bbb4629_dd25_4dae_b2a0_be0099cacaeb.slice/crio-e69959f8fe774d281b347acd15309b101903f107b1dd251aba28df3bc02afdcd WatchSource:0}: Error finding container e69959f8fe774d281b347acd15309b101903f107b1dd251aba28df3bc02afdcd: Status 404 returned error can't find the container with id e69959f8fe774d281b347acd15309b101903f107b1dd251aba28df3bc02afdcd
Oct 30 02:55:04.165955 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:04.165935    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd1c3b69_f5f0_415e_a4a1_2be07d7d1887.slice/crio-98411c164c65cc49d1894155d122f6f006daa9e2326f1d52619163e0c8f00718 WatchSource:0}: Error finding container 98411c164c65cc49d1894155d122f6f006daa9e2326f1d52619163e0c8f00718: Status 404 returned error can't find the container with id 98411c164c65cc49d1894155d122f6f006daa9e2326f1d52619163e0c8f00718
Oct 30 02:55:04.187445 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.187423    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:04.195722 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.195704    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:04.200097 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.200079    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:04.210790 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:04.210768    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa93acd_52e0_4abe_ab94_12c4b3105126.slice/crio-fd0149dbc41f1573530592c1dbd95b45c5bb1465cd7fe1531d02f835bb4b28b3 WatchSource:0}: Error finding container fd0149dbc41f1573530592c1dbd95b45c5bb1465cd7fe1531d02f835bb4b28b3: Status 404 returned error can't find the container with id fd0149dbc41f1573530592c1dbd95b45c5bb1465cd7fe1531d02f835bb4b28b3
Oct 30 02:55:04.506493 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.506456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:04.506649 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.506516    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs\") pod \"network-metrics-daemon-zxzxk\" (UID: \"e7a138e6-2485-4134-9d3a-c2419d154f30\") " pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:04.506649 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:04.506607    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 02:55:04.506649 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:04.506623    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:55:04.506831 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:04.506672    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret podName:f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc nodeName:}" failed. No retries permitted until 2026-10-30 02:55:05.506653659 +0000 UTC m=+4.060161876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret") pod "global-pull-secret-syncer-lg4vm" (UID: "f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc") : object "kube-system"/"original-pull-secret" not registered
Oct 30 02:55:04.506831 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:04.506713    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs podName:e7a138e6-2485-4134-9d3a-c2419d154f30 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:05.506682355 +0000 UTC m=+4.060190562 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs") pod "network-metrics-daemon-zxzxk" (UID: "e7a138e6-2485-4134-9d3a-c2419d154f30") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:55:04.608303 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.607824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drz2l\" (UniqueName: \"kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l\") pod \"network-check-target-p7mkl\" (UID: \"46ab1416-b4cf-4b29-b8b3-38fdf77db001\") " pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:04.608303 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:04.607948    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 02:55:04.608303 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:04.607961    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 02:55:04.608303 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:04.607977    2576 projected.go:196] Error preparing data for projected volume kube-api-access-drz2l for pod openshift-network-diagnostics/network-check-target-p7mkl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:55:04.608303 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:04.608018    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l podName:46ab1416-b4cf-4b29-b8b3-38fdf77db001 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:05.608005647 +0000 UTC m=+4.161513850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-drz2l" (UniqueName: "kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l") pod "network-check-target-p7mkl" (UID: "46ab1416-b4cf-4b29-b8b3-38fdf77db001") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:55:04.847097 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.847033    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 02:50:03 +0000 UTC" deadline="2028-06-27 12:19:44.994583042 +0000 UTC"
Oct 30 02:55:04.847097 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.847092    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14553h24m40.147494624s"
Oct 30 02:55:04.877759 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.877721    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-twcgj" event={"ID":"bd1c3b69-f5f0-415e-a4a1-2be07d7d1887","Type":"ContainerStarted","Data":"98411c164c65cc49d1894155d122f6f006daa9e2326f1d52619163e0c8f00718"}
Oct 30 02:55:04.883052 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.883021    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ttjnv" event={"ID":"322fa146-852c-4aca-a334-e9ba4e23d8ad","Type":"ContainerStarted","Data":"49a9b21ab3550493e45c7862e6578c96e20198340da742eee902e28646cc06e5"}
Oct 30 02:55:04.891577 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.891546    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w29gr" event={"ID":"207f380c-c390-48c7-8df5-2d828b166284","Type":"ContainerStarted","Data":"741cb22141c0b9a04b7127e47ff0f6e2ceba96e893cb4ca929c14a06c88ecc82"}
Oct 30 02:55:04.904744 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.904712    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cvsmc" event={"ID":"7d4449be-5ad9-45a2-a708-8935ea16fed1","Type":"ContainerStarted","Data":"a282c6dc95965d366bf89fc39cb76170011e226f46269643466fc13519a91462"}
Oct 30 02:55:04.912480 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.912453    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-40.ec2.internal" event={"ID":"13718fab620286fdb285c77e4037fd98","Type":"ContainerStarted","Data":"6b1f8e46990e67d97d1b60840a459a87a295ef7b3dcbb27d3e1b09710dcd96a0"}
Oct 30 02:55:04.926868 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.926838    2576 generic.go:356] "Generic (PLEG): container finished" podID="1e8aeea066a252cd4be40281f35c3f01" containerID="d5e5e684027962e131d6cd504f76252abb3e21095bd9bd23e2a4354120993ecc" exitCode=0
Oct 30 02:55:04.926974 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.926909    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal" event={"ID":"1e8aeea066a252cd4be40281f35c3f01","Type":"ContainerDied","Data":"d5e5e684027962e131d6cd504f76252abb3e21095bd9bd23e2a4354120993ecc"}
Oct 30 02:55:04.938843 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.938813    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6frn" event={"ID":"67e06851-bb40-4be7-87dd-36b84f182f8c","Type":"ContainerStarted","Data":"7c4bc173d0fc2f93b0e01aa9dd4c04cd1100e1f9abee52930e759fc2d971ff25"}
Oct 30 02:55:04.948955 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.948875    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5" event={"ID":"a707ea73-de7e-406f-89ec-9197a6c0f2b5","Type":"ContainerStarted","Data":"230ac6de6e893d97e822445db3f2b1d39dc58f65c5bf1ed0d369978489c599b2"}
Oct 30 02:55:04.970558 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.970476    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg" event={"ID":"4aa93acd-52e0-4abe-ab94-12c4b3105126","Type":"ContainerStarted","Data":"fd0149dbc41f1573530592c1dbd95b45c5bb1465cd7fe1531d02f835bb4b28b3"}
Oct 30 02:55:04.978625 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.978604    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7jm4j" event={"ID":"3bbb4629-dd25-4dae-b2a0-be0099cacaeb","Type":"ContainerStarted","Data":"e69959f8fe774d281b347acd15309b101903f107b1dd251aba28df3bc02afdcd"}
Oct 30 02:55:04.994446 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:04.994391    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s8pxs" event={"ID":"dec5346e-cd73-40b5-bcf4-05bc1a7e33e2","Type":"ContainerStarted","Data":"2f28b1ac5fdb018e3800d9e19facff06b608e94d618b8cbf614cf4a102ac4179"}
Oct 30 02:55:05.002563 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:05.002258    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-40.ec2.internal" podStartSLOduration=2.002241759 podStartE2EDuration="2.002241759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:55:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:04.959907801 +0000 UTC m=+3.513416029" watchObservedRunningTime="2026-10-30 02:55:05.002241759 +0000 UTC m=+3.555749986"
Oct 30 02:55:05.515443 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:05.515163    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs\") pod \"network-metrics-daemon-zxzxk\" (UID: \"e7a138e6-2485-4134-9d3a-c2419d154f30\") " pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:05.515644 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:05.515454    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:05.515644 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:05.515582    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 02:55:05.515644 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:05.515641    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret podName:f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc nodeName:}" failed. No retries permitted until 2026-10-30 02:55:07.515623129 +0000 UTC m=+6.069131345 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret") pod "global-pull-secret-syncer-lg4vm" (UID: "f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc") : object "kube-system"/"original-pull-secret" not registered
Oct 30 02:55:05.515916 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:05.515819    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:55:05.515916 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:05.515879    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs podName:e7a138e6-2485-4134-9d3a-c2419d154f30 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:07.51586314 +0000 UTC m=+6.069371348 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs") pod "network-metrics-daemon-zxzxk" (UID: "e7a138e6-2485-4134-9d3a-c2419d154f30") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:55:05.615987 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:05.615949    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drz2l\" (UniqueName: \"kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l\") pod \"network-check-target-p7mkl\" (UID: \"46ab1416-b4cf-4b29-b8b3-38fdf77db001\") " pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:05.616160 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:05.616143    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 02:55:05.616224 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:05.616166    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 02:55:05.616224 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:05.616179    2576 projected.go:196] Error preparing data for projected volume kube-api-access-drz2l for pod openshift-network-diagnostics/network-check-target-p7mkl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:55:05.616324 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:05.616237    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l podName:46ab1416-b4cf-4b29-b8b3-38fdf77db001 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:07.61621924 +0000 UTC m=+6.169727456 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-drz2l" (UniqueName: "kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l") pod "network-check-target-p7mkl" (UID: "46ab1416-b4cf-4b29-b8b3-38fdf77db001") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:55:05.848164 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:05.848059    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 02:50:03 +0000 UTC" deadline="2028-04-17 20:33:57.7620499 +0000 UTC"
Oct 30 02:55:05.848164 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:05.848116    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12857h38m51.913937676s"
Oct 30 02:55:05.859871 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:05.859844    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:05.860022 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:05.859979    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxzxk" podUID="e7a138e6-2485-4134-9d3a-c2419d154f30"
Oct 30 02:55:05.860390 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:05.860366    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:05.860548 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:05.860469    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4vm" podUID="f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc"
Oct 30 02:55:05.860548 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:05.860508    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:05.860650 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:05.860572    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7mkl" podUID="46ab1416-b4cf-4b29-b8b3-38fdf77db001"
Oct 30 02:55:06.005344 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:06.005301    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal" event={"ID":"1e8aeea066a252cd4be40281f35c3f01","Type":"ContainerStarted","Data":"bf64b706b4dc03eeaa9de2aab391ecd8fcfeefb0cfefcb23655e533f38ce6b66"}
Oct 30 02:55:07.531810 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:07.531107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:07.531810 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:07.531172    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs\") pod \"network-metrics-daemon-zxzxk\" (UID: \"e7a138e6-2485-4134-9d3a-c2419d154f30\") " pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:07.531810 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:07.531246    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 02:55:07.531810 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:07.531287    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:55:07.531810 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:07.531355    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret podName:f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc nodeName:}" failed. No retries permitted until 2026-10-30 02:55:11.531333225 +0000 UTC m=+10.084841430 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret") pod "global-pull-secret-syncer-lg4vm" (UID: "f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc") : object "kube-system"/"original-pull-secret" not registered
Oct 30 02:55:07.531810 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:07.531425    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs podName:e7a138e6-2485-4134-9d3a-c2419d154f30 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:11.531407288 +0000 UTC m=+10.084915507 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs") pod "network-metrics-daemon-zxzxk" (UID: "e7a138e6-2485-4134-9d3a-c2419d154f30") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:55:07.632509 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:07.631875    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drz2l\" (UniqueName: \"kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l\") pod \"network-check-target-p7mkl\" (UID: \"46ab1416-b4cf-4b29-b8b3-38fdf77db001\") " pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:07.632509 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:07.632090    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 02:55:07.632509 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:07.632110    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 02:55:07.632509 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:07.632122    2576 projected.go:196] Error preparing data for projected volume kube-api-access-drz2l for pod openshift-network-diagnostics/network-check-target-p7mkl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:55:07.632509 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:07.632176    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l podName:46ab1416-b4cf-4b29-b8b3-38fdf77db001 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:11.63215954 +0000 UTC m=+10.185667757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-drz2l" (UniqueName: "kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l") pod "network-check-target-p7mkl" (UID: "46ab1416-b4cf-4b29-b8b3-38fdf77db001") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:55:07.861306 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:07.861241    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:07.861439 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:07.861374    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxzxk" podUID="e7a138e6-2485-4134-9d3a-c2419d154f30"
Oct 30 02:55:07.861776 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:07.861742    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:07.861875 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:07.861854    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4vm" podUID="f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc"
Oct 30 02:55:07.861875 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:07.861855    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:07.861978 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:07.861939    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7mkl" podUID="46ab1416-b4cf-4b29-b8b3-38fdf77db001"
Oct 30 02:55:08.016833 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:08.016794    2576 generic.go:356] "Generic (PLEG): container finished" podID="67e06851-bb40-4be7-87dd-36b84f182f8c" containerID="27788d67cdc8513a515a862327c004c99f2fe839ac8a6b9dc74737dfa762104a" exitCode=0
Oct 30 02:55:08.016925 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:08.016891    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6frn" event={"ID":"67e06851-bb40-4be7-87dd-36b84f182f8c","Type":"ContainerDied","Data":"27788d67cdc8513a515a862327c004c99f2fe839ac8a6b9dc74737dfa762104a"}
Oct 30 02:55:08.100094 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:08.099921    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal" podStartSLOduration=5.099903887 podStartE2EDuration="5.099903887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:55:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:06.046011083 +0000 UTC m=+4.599519308" watchObservedRunningTime="2026-10-30 02:55:08.099903887 +0000 UTC m=+6.653412115"
Oct 30 02:55:09.032234 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:09.031098    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7jm4j" event={"ID":"3bbb4629-dd25-4dae-b2a0-be0099cacaeb","Type":"ContainerStarted","Data":"d5c41e7839c9314777c3374ed6f6a5ccde2ece1a53d9cdb347d3b20bc63a8f69"}
Oct 30 02:55:09.072275 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:09.071809    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7jm4j" podStartSLOduration=3.41468075 podStartE2EDuration="7.07178977s" totalImagesPullingTime="3.65710902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:09.071041128 +0000 UTC m=+7.624549354" watchObservedRunningTime="2026-10-30 02:55:09.07178977 +0000 UTC m=+7.625298012"
Oct 30 02:55:09.074042 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:09.073890    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7jm4j"
Oct 30 02:55:09.074483 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:09.074325    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7jm4j"
Oct 30 02:55:09.438085 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:09.437978    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7jm4j"
Oct 30 02:55:09.438470 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:09.438452    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7jm4j"
Oct 30 02:55:09.860295 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:09.859843    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:09.860295 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:09.859858    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:09.860295 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:09.859966    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7mkl" podUID="46ab1416-b4cf-4b29-b8b3-38fdf77db001"
Oct 30 02:55:09.860295 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:09.860013    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:09.860295 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:09.860134    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxzxk" podUID="e7a138e6-2485-4134-9d3a-c2419d154f30"
Oct 30 02:55:09.860295 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:09.860192    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4vm" podUID="f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc"
Oct 30 02:55:10.038300 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:10.038214    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5" event={"ID":"a707ea73-de7e-406f-89ec-9197a6c0f2b5","Type":"ContainerStarted","Data":"d78b84fdfccfee62fdf5d6285bd72c9286b6390616c60e74e41578f04ae62199"}
Oct 30 02:55:10.040494 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:10.040436    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s8pxs" event={"ID":"dec5346e-cd73-40b5-bcf4-05bc1a7e33e2","Type":"ContainerStarted","Data":"98635354dcafe0df6f875186f29733f101c24be61340c1f292a7f58b86d6749e"}
Oct 30 02:55:11.437919 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:11.437897    2576 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 02:55:11.562862 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:11.562817    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs\") pod \"network-metrics-daemon-zxzxk\" (UID: \"e7a138e6-2485-4134-9d3a-c2419d154f30\") " pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:11.563039 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:11.562910    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:11.563103 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:11.563038    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 02:55:11.563156 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:11.563108    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret podName:f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc nodeName:}" failed. No retries permitted until 2026-10-30 02:55:19.563088756 +0000 UTC m=+18.116596983 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret") pod "global-pull-secret-syncer-lg4vm" (UID: "f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc") : object "kube-system"/"original-pull-secret" not registered
Oct 30 02:55:11.563528 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:11.563512    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:55:11.563614 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:11.563561    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs podName:e7a138e6-2485-4134-9d3a-c2419d154f30 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:19.563546988 +0000 UTC m=+18.117055208 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs") pod "network-metrics-daemon-zxzxk" (UID: "e7a138e6-2485-4134-9d3a-c2419d154f30") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:55:11.664156 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:11.664114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drz2l\" (UniqueName: \"kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l\") pod \"network-check-target-p7mkl\" (UID: \"46ab1416-b4cf-4b29-b8b3-38fdf77db001\") " pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:11.664322 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:11.664305    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 02:55:11.664381 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:11.664331    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 02:55:11.664381 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:11.664345    2576 projected.go:196] Error preparing data for projected volume kube-api-access-drz2l for pod openshift-network-diagnostics/network-check-target-p7mkl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:55:11.664488 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:11.664405    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l podName:46ab1416-b4cf-4b29-b8b3-38fdf77db001 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:19.664387143 +0000 UTC m=+18.217895364 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-drz2l" (UniqueName: "kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l") pod "network-check-target-p7mkl" (UID: "46ab1416-b4cf-4b29-b8b3-38fdf77db001") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:55:11.854801 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:11.854666    2576 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T02:55:11.437915397Z","UUID":"7e7cf6f1-1ba6-4d3c-824c-75ddb16ff609","Handler":null,"Name":"","Endpoint":""}
Oct 30 02:55:11.856547 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:11.856450    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 02:55:11.857068 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:11.856833    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 02:55:11.861646 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:11.859925    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:11.861646 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:11.859947    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:11.861646 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:11.860026    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4vm" podUID="f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc"
Oct 30 02:55:11.861646 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:11.860065    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7mkl" podUID="46ab1416-b4cf-4b29-b8b3-38fdf77db001"
Oct 30 02:55:11.861646 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:11.860092    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:11.861646 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:11.860243    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxzxk" podUID="e7a138e6-2485-4134-9d3a-c2419d154f30"
Oct 30 02:55:12.049418 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:12.049301    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5" event={"ID":"a707ea73-de7e-406f-89ec-9197a6c0f2b5","Type":"ContainerStarted","Data":"18f693d31129c7c43cf956e08b2e8350e537907c4074a2c39f299f76703bddda"}
Oct 30 02:55:12.051658 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:12.051112    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ttjnv" event={"ID":"322fa146-852c-4aca-a334-e9ba4e23d8ad","Type":"ContainerStarted","Data":"e16d46eeec43ed759dd8b4601ed8ddd1b382ac9c4140b0c13a4c9a2f3ca091a8"}
Oct 30 02:55:12.053556 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:12.053535    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cvsmc" event={"ID":"7d4449be-5ad9-45a2-a708-8935ea16fed1","Type":"ContainerStarted","Data":"5bd046185b29a683bec41a3e0535230c42d21181199d3a1f3a7875944195d020"}
Oct 30 02:55:12.091587 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:12.090898    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-ttjnv" podStartSLOduration=2.495397516 podStartE2EDuration="10.090882653s" totalImagesPullingTime="7.595485137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:12.090864252 +0000 UTC m=+10.644372475" watchObservedRunningTime="2026-10-30 02:55:12.090882653 +0000 UTC m=+10.644390879"
Oct 30 02:55:12.091587 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:12.091112    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s8pxs" podStartSLOduration=6.221829155 podStartE2EDuration="11.091104264s" totalImagesPullingTime="4.869275109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:10.079708175 +0000 UTC m=+8.633216429" watchObservedRunningTime="2026-10-30 02:55:12.091104264 +0000 UTC m=+10.644612488"
Oct 30 02:55:12.133799 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:12.133735    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-cvsmc" podStartSLOduration=3.844939188 podStartE2EDuration="11.133718509s" totalImagesPullingTime="7.288779321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:12.133010619 +0000 UTC m=+10.686518843" watchObservedRunningTime="2026-10-30 02:55:12.133718509 +0000 UTC m=+10.687226734"
Oct 30 02:55:13.057107 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:13.057059    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-twcgj" event={"ID":"bd1c3b69-f5f0-415e-a4a1-2be07d7d1887","Type":"ContainerStarted","Data":"badf84f25310e692cb889ddf09463ff1268c77037352fc3a1ee9f57344ee4811"}
Oct 30 02:55:13.059345 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:13.059315    2576 generic.go:356] "Generic (PLEG): container finished" podID="67e06851-bb40-4be7-87dd-36b84f182f8c" containerID="b001a1646111a0668d0220ecafc2f2f066493167bc19425a92b152aed0baeaee" exitCode=0
Oct 30 02:55:13.059464 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:13.059404    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6frn" event={"ID":"67e06851-bb40-4be7-87dd-36b84f182f8c","Type":"ContainerDied","Data":"b001a1646111a0668d0220ecafc2f2f066493167bc19425a92b152aed0baeaee"}
Oct 30 02:55:13.062818 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:13.062412    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5" event={"ID":"a707ea73-de7e-406f-89ec-9197a6c0f2b5","Type":"ContainerStarted","Data":"775493484a0eedf462d4d5790706150c4ee27424072e8a081e826a131a46ca94"}
Oct 30 02:55:13.097023 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:13.096936    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-twcgj" podStartSLOduration=3.786243345 podStartE2EDuration="11.096923803s" totalImagesPullingTime="7.310680458s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:13.096396215 +0000 UTC m=+11.649904440" watchObservedRunningTime="2026-10-30 02:55:13.096923803 +0000 UTC m=+11.650432029"
Oct 30 02:55:13.142016 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:13.141963    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5" podStartSLOduration=3.344494208 podStartE2EDuration="11.14194901s" totalImagesPullingTime="7.797454802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:55:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:13.141348635 +0000 UTC m=+11.694856862" watchObservedRunningTime="2026-10-30 02:55:13.14194901 +0000 UTC m=+11.695457240"
Oct 30 02:55:13.858896 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:13.858648    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:13.859052 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:13.858660    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:13.859052 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:13.859006    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7mkl" podUID="46ab1416-b4cf-4b29-b8b3-38fdf77db001"
Oct 30 02:55:13.859052 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:13.858711    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:13.859192 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:13.859085    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxzxk" podUID="e7a138e6-2485-4134-9d3a-c2419d154f30"
Oct 30 02:55:13.859192 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:13.859125    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4vm" podUID="f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc"
Oct 30 02:55:14.066359 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:14.066329    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w29gr" event={"ID":"207f380c-c390-48c7-8df5-2d828b166284","Type":"ContainerStarted","Data":"d4303d206effa0209a2508e336fcb69485f1d567aefc493c1ade4443e7d63c42"}
Oct 30 02:55:14.109168 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:14.109128    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w29gr" podStartSLOduration=2.6023536910000002 podStartE2EDuration="12.109115376s" totalImagesPullingTime="9.506761685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:14.10887981 +0000 UTC m=+12.662388035" watchObservedRunningTime="2026-10-30 02:55:14.109115376 +0000 UTC m=+12.662623601"
Oct 30 02:55:15.070891 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:15.070857    2576 generic.go:356] "Generic (PLEG): container finished" podID="67e06851-bb40-4be7-87dd-36b84f182f8c" containerID="11166a861b0ef756acc4aec37cdf8db10826448f076310d6f652ed977c796913" exitCode=0
Oct 30 02:55:15.071568 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:15.070926    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6frn" event={"ID":"67e06851-bb40-4be7-87dd-36b84f182f8c","Type":"ContainerDied","Data":"11166a861b0ef756acc4aec37cdf8db10826448f076310d6f652ed977c796913"}
Oct 30 02:55:15.858898 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:15.858861    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:15.859048 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:15.859003    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxzxk" podUID="e7a138e6-2485-4134-9d3a-c2419d154f30"
Oct 30 02:55:15.859675 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:15.859645    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:15.859817 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:15.859763    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4vm" podUID="f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc"
Oct 30 02:55:15.859905 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:15.859856    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:15.859960 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:15.859936    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7mkl" podUID="46ab1416-b4cf-4b29-b8b3-38fdf77db001"
Oct 30 02:55:17.078171 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:17.078132    2576 generic.go:356] "Generic (PLEG): container finished" podID="67e06851-bb40-4be7-87dd-36b84f182f8c" containerID="7b2c329d9b440d46e9b9adefbf1872633e77e5e725b00656142a00866402ad8e" exitCode=0
Oct 30 02:55:17.078887 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:17.078198    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6frn" event={"ID":"67e06851-bb40-4be7-87dd-36b84f182f8c","Type":"ContainerDied","Data":"7b2c329d9b440d46e9b9adefbf1872633e77e5e725b00656142a00866402ad8e"}
Oct 30 02:55:17.858568 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:17.858536    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:17.858762 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:17.858540    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:17.858762 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:17.858670    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxzxk" podUID="e7a138e6-2485-4134-9d3a-c2419d154f30"
Oct 30 02:55:17.858762 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:17.858540    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:17.858927 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:17.858781    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4vm" podUID="f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc"
Oct 30 02:55:17.858927 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:17.858854    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7mkl" podUID="46ab1416-b4cf-4b29-b8b3-38fdf77db001"
Oct 30 02:55:19.084859 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:19.084480    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg" event={"ID":"4aa93acd-52e0-4abe-ab94-12c4b3105126","Type":"ContainerStarted","Data":"0e4f631ec9fea1ddd409d862ece91a126da0f5341e1433982b692ce51ff1e4d8"}
Oct 30 02:55:19.085267 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:19.084908    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg" event={"ID":"4aa93acd-52e0-4abe-ab94-12c4b3105126","Type":"ContainerStarted","Data":"169fba317a8b19a41af49bf5ece2a0b4bcb124a8ded733b4400080652a80c6d4"}
Oct 30 02:55:19.085267 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:19.084943    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg" event={"ID":"4aa93acd-52e0-4abe-ab94-12c4b3105126","Type":"ContainerStarted","Data":"c35a55479af3c737f11155922e31bb6f095d63b792713cb8a7aa03fc32950358"}
Oct 30 02:55:19.085267 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:19.084981    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg" event={"ID":"4aa93acd-52e0-4abe-ab94-12c4b3105126","Type":"ContainerStarted","Data":"11827dba0d027bb28526f07f1c95db1e3e75aa5f3608dbaeba1c6aa9c6e1a857"}
Oct 30 02:55:19.085267 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:19.085023    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg" event={"ID":"4aa93acd-52e0-4abe-ab94-12c4b3105126","Type":"ContainerStarted","Data":"bc1fa8c9afd7a26c3feeb4d97998b58a71a472e381978185bb6a2d81b64dc5d8"}
Oct 30 02:55:19.085267 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:19.085054    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg" event={"ID":"4aa93acd-52e0-4abe-ab94-12c4b3105126","Type":"ContainerStarted","Data":"c6af521e45dfe703e869e948383c225bc3b57ebedf9947d61493b8751fd7c791"}
Oct 30 02:55:19.087066 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:19.087041    2576 generic.go:356] "Generic (PLEG): container finished" podID="67e06851-bb40-4be7-87dd-36b84f182f8c" containerID="26424f6a6746146800a0a1c14c9a3f84164bac7e531eeb721f2032dec400f7de" exitCode=0
Oct 30 02:55:19.087146 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:19.087072    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6frn" event={"ID":"67e06851-bb40-4be7-87dd-36b84f182f8c","Type":"ContainerDied","Data":"26424f6a6746146800a0a1c14c9a3f84164bac7e531eeb721f2032dec400f7de"}
Oct 30 02:55:19.632458 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:19.632414    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:19.632587 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:19.632470    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs\") pod \"network-metrics-daemon-zxzxk\" (UID: \"e7a138e6-2485-4134-9d3a-c2419d154f30\") " pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:19.632587 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:19.632560    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 02:55:19.632662 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:19.632618    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret podName:f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.632605013 +0000 UTC m=+34.186113220 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret") pod "global-pull-secret-syncer-lg4vm" (UID: "f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc") : object "kube-system"/"original-pull-secret" not registered
Oct 30 02:55:19.632662 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:19.632563    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:55:19.632768 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:19.632703    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs podName:e7a138e6-2485-4134-9d3a-c2419d154f30 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.632675446 +0000 UTC m=+34.186183664 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs") pod "network-metrics-daemon-zxzxk" (UID: "e7a138e6-2485-4134-9d3a-c2419d154f30") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:55:19.733053 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:19.733024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drz2l\" (UniqueName: \"kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l\") pod \"network-check-target-p7mkl\" (UID: \"46ab1416-b4cf-4b29-b8b3-38fdf77db001\") " pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:19.733182 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:19.733167    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 02:55:19.733216 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:19.733186    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 02:55:19.733216 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:19.733197    2576 projected.go:196] Error preparing data for projected volume kube-api-access-drz2l for pod openshift-network-diagnostics/network-check-target-p7mkl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:55:19.733287 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:19.733242    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l podName:46ab1416-b4cf-4b29-b8b3-38fdf77db001 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.733226 +0000 UTC m=+34.286734218 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-drz2l" (UniqueName: "kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l") pod "network-check-target-p7mkl" (UID: "46ab1416-b4cf-4b29-b8b3-38fdf77db001") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:55:19.858970 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:19.858938    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:19.859116 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:19.858952    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:19.859116 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:19.859034    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4vm" podUID="f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc"
Oct 30 02:55:19.859116 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:19.859057    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:19.859217 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:19.859144    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxzxk" podUID="e7a138e6-2485-4134-9d3a-c2419d154f30"
Oct 30 02:55:19.859248 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:19.859212    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7mkl" podUID="46ab1416-b4cf-4b29-b8b3-38fdf77db001"
Oct 30 02:55:20.091867 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:20.091789    2576 generic.go:356] "Generic (PLEG): container finished" podID="67e06851-bb40-4be7-87dd-36b84f182f8c" containerID="bd78a5a6c1613ec730994d56d052b92e08ca6adec81135a88d825867569ba621" exitCode=0
Oct 30 02:55:20.091867 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:20.091843    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6frn" event={"ID":"67e06851-bb40-4be7-87dd-36b84f182f8c","Type":"ContainerDied","Data":"bd78a5a6c1613ec730994d56d052b92e08ca6adec81135a88d825867569ba621"}
Oct 30 02:55:21.097091 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:21.097058    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6frn" event={"ID":"67e06851-bb40-4be7-87dd-36b84f182f8c","Type":"ContainerStarted","Data":"ee765e31b5c37be8697993afd6456c7f7f69f0d0ab9b070c11f60d205e35be46"}
Oct 30 02:55:21.100125 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:21.100103    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg" event={"ID":"4aa93acd-52e0-4abe-ab94-12c4b3105126","Type":"ContainerStarted","Data":"e169fdaf68f9f933ea78f0cd1659e9f9f9554354b510b563f49155b9deec7e34"}
Oct 30 02:55:21.168226 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:21.168154    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r6frn" podStartSLOduration=8.536671606 podStartE2EDuration="19.168142089s" totalImagesPullingTime="10.631470483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:55:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:21.167813843 +0000 UTC m=+19.721322070" watchObservedRunningTime="2026-10-30 02:55:21.168142089 +0000 UTC m=+19.721650313"
Oct 30 02:55:21.859083 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:21.859050    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:21.859255 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:21.859153    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:21.859255 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:21.859169    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxzxk" podUID="e7a138e6-2485-4134-9d3a-c2419d154f30"
Oct 30 02:55:21.859369 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:21.859250    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7mkl" podUID="46ab1416-b4cf-4b29-b8b3-38fdf77db001"
Oct 30 02:55:21.859369 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:21.859270    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:21.859445 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:21.859378    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4vm" podUID="f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc"
Oct 30 02:55:23.107552 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:23.107516    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg" event={"ID":"4aa93acd-52e0-4abe-ab94-12c4b3105126","Type":"ContainerStarted","Data":"37d36c1492301dade06c12d23ef28754280e7cede802a9af51339837731bcec2"}
Oct 30 02:55:23.108154 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:23.107940    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:23.122501 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:23.122471    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:23.199710 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:23.199648    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg" podStartSLOduration=6.906612188 podStartE2EDuration="21.19963616s" totalImagesPullingTime="14.293023972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:23.198930222 +0000 UTC m=+21.752438489" watchObservedRunningTime="2026-10-30 02:55:23.19963616 +0000 UTC m=+21.753144386"
Oct 30 02:55:23.859361 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:23.859193    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:23.859590 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:23.859285    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:23.859590 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:23.859435    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxzxk" podUID="e7a138e6-2485-4134-9d3a-c2419d154f30"
Oct 30 02:55:23.859590 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:23.859522    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4vm" podUID="f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc"
Oct 30 02:55:23.859590 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:23.859293    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:23.859768 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:23.859599    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7mkl" podUID="46ab1416-b4cf-4b29-b8b3-38fdf77db001"
Oct 30 02:55:24.110071 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:24.110005    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:24.110412 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:24.110085    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:24.124856 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:24.124832    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:25.105615 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:25.105584    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lg4vm"]
Oct 30 02:55:25.105778 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:25.105699    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:25.105820 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:25.105801    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4vm" podUID="f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc"
Oct 30 02:55:25.109109 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:25.109083    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p7mkl"]
Oct 30 02:55:25.109223 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:25.109172    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:25.109271 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:25.109248    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7mkl" podUID="46ab1416-b4cf-4b29-b8b3-38fdf77db001"
Oct 30 02:55:25.117179 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:25.117155    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zxzxk"]
Oct 30 02:55:25.117497 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:25.117225    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:25.117497 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:25.117296    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxzxk" podUID="e7a138e6-2485-4134-9d3a-c2419d154f30"
Oct 30 02:55:26.858966 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:26.858935    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:26.859443 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:26.859032    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:26.859443 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:26.859046    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7mkl" podUID="46ab1416-b4cf-4b29-b8b3-38fdf77db001"
Oct 30 02:55:26.859443 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:26.859058    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:26.859443 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:26.859126    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxzxk" podUID="e7a138e6-2485-4134-9d3a-c2419d154f30"
Oct 30 02:55:26.859443 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:26.859187    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4vm" podUID="f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc"
Oct 30 02:55:28.859228 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:28.859197    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:28.859573 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:28.859197    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:28.859573 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:28.859312    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxzxk" podUID="e7a138e6-2485-4134-9d3a-c2419d154f30"
Oct 30 02:55:28.859573 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:28.859197    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:28.859573 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:28.859376    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7mkl" podUID="46ab1416-b4cf-4b29-b8b3-38fdf77db001"
Oct 30 02:55:28.859573 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:28.859444    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4vm" podUID="f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc"
Oct 30 02:55:30.859095 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:30.859013    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:30.859095 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:30.859036    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:30.859491 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:30.859147    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxzxk" podUID="e7a138e6-2485-4134-9d3a-c2419d154f30"
Oct 30 02:55:30.859491 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:30.859189    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:30.859491 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:30.859259    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg4vm" podUID="f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc"
Oct 30 02:55:30.859491 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:30.859321    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7mkl" podUID="46ab1416-b4cf-4b29-b8b3-38fdf77db001"
Oct 30 02:55:31.195569 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.195540    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeReady"
Oct 30 02:55:31.195726 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.195679    2576 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 02:55:31.256764 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.256736    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-dtw44"]
Oct 30 02:55:31.259760 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.259741    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-fvrpn"]
Oct 30 02:55:31.259876 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.259857    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-dtw44"
Oct 30 02:55:31.262923 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.262902    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-kss29"]
Oct 30 02:55:31.263029 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.263007    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-fvrpn"
Oct 30 02:55:31.266721 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.266627    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-sppcg"]
Oct 30 02:55:31.266793 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.266763    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:31.270208 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.270192    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"]
Oct 30 02:55:31.270314 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.270297    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-sppcg"
Oct 30 02:55:31.273877 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.273862    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57b8cd6f65-mwg8n"]
Oct 30 02:55:31.273977 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.273964    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"
Oct 30 02:55:31.277130 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.277116    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"]
Oct 30 02:55:31.277239 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.277224    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.280711 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.280680    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj"]
Oct 30 02:55:31.280982 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.280880    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:31.289840 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.289818    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cxwq4"]
Oct 30 02:55:31.290081 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.290062    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.290304 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.290260    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.290394 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.290319    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj"
Oct 30 02:55:31.294593 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.294564    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-88cb97fb-qnc8x"]
Oct 30 02:55:31.294785 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.294766    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cxwq4"
Oct 30 02:55:31.297261 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.297242    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-glqfz"]
Oct 30 02:55:31.297341 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.297327    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.301069 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.301045    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ftq8q"]
Oct 30 02:55:31.301160 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.301144    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:31.303014 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.302993    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 02:55:31.303791 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.303772    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 02:55:31.304247 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.304227    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-v5ppj"]
Oct 30 02:55:31.304734 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.304715    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:31.311715 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.309878    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"]
Oct 30 02:55:31.311715 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.311185    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-v5ppj"
Oct 30 02:55:31.313667 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.313629    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-67f9ffd857-gnqzw"]
Oct 30 02:55:31.313912 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.313895    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:31.316384 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.316363    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz"]
Oct 30 02:55:31.317040 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.317021    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:31.319349 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.319329    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xqnbh"]
Oct 30 02:55:31.319474 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.319413    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz"
Oct 30 02:55:31.324085 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.324010    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-dtw44"]
Oct 30 02:55:31.324085 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.324054    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-kss29"]
Oct 30 02:55:31.324085 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.324076    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-fvrpn"]
Oct 30 02:55:31.324362 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.324093    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xqnbh"
Oct 30 02:55:31.324474 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.324099    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"]
Oct 30 02:55:31.328285 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.324533    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57b8cd6f65-mwg8n"]
Oct 30 02:55:31.328377 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.328317    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"]
Oct 30 02:55:31.328377 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.328351    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj"]
Oct 30 02:55:31.328377 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.328371    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cxwq4"]
Oct 30 02:55:31.328528 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.328390    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-88cb97fb-qnc8x"]
Oct 30 02:55:31.328528 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.328407    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-sppcg"]
Oct 30 02:55:31.328528 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.328426    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xqnbh"]
Oct 30 02:55:31.328528 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.328444    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-v5ppj"]
Oct 30 02:55:31.328528 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.328462    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67f9ffd857-gnqzw"]
Oct 30 02:55:31.329141 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.329119    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ftq8q"]
Oct 30 02:55:31.335913 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.335892    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"]
Oct 30 02:55:31.338340 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.338319    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz"]
Oct 30 02:55:31.350709 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.350676    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-glqfz"]
Oct 30 02:55:31.384296 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.384274    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.384296 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.384288    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 02:55:31.384612 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.384297    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.384612 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.384327    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.384612 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.384367    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 02:55:31.384612 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.384373    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 02:55:31.384612 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.384467    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.384612 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.384473    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.384926 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.384776    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.384926 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.384877    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 02:55:31.384926 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.384898    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 02:55:31.384926 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.384924    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.385157 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.384933    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 02:55:31.385157 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.384959    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.385157 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.384997    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.385157 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.385020    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.385157 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.385026    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.385157 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.385144    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.385422 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.385383    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.385546 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.385489    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.385625 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.385605    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 02:55:31.386019 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.385996    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.386140 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.386125    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.386230 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.386196    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 02:55:31.386393 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.386376    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 02:55:31.386464 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.386428    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.386464 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.386444    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.386600 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.386574    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:31.386914 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.386885    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:31.397434 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397411    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 02:55:31.397539 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397456    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 02:55:31.397539 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397461    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 02:55:31.397539 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397468    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 02:55:31.397539 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397484    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 02:55:31.397539 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397490    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 02:55:31.397539 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397526    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gjrvb\""
Oct 30 02:55:31.397839 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397550    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 02:55:31.397839 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397577    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 02:55:31.397839 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397583    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 02:55:31.397839 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397595    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cth5s\""
Oct 30 02:55:31.397839 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397613    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 02:55:31.397839 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397634    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 02:55:31.397839 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397637    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 02:55:31.397839 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397661    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 02:55:31.397839 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397717    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 02:55:31.397839 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397744    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-44jtl\""
Oct 30 02:55:31.397839 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397795    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fm748\""
Oct 30 02:55:31.397839 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397799    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 02:55:31.398381 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397852    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-qtb58\""
Oct 30 02:55:31.398381 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.397934    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 02:55:31.418931 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.418907    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-certificates\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.419000 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.418933    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncgfc\" (UniqueName: \"kubernetes.io/projected/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0-kube-api-access-ncgfc\") pod \"service-ca-operator-544d749c8c-7j4nj\" (UID: \"d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj"
Oct 30 02:55:31.419000 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.418953    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znv57\" (UniqueName: \"kubernetes.io/projected/008e880d-1e3d-4290-b25f-442ee1d90975-kube-api-access-znv57\") pod \"kas-connection-checker-685895c7c9-fvrpn\" (UID: \"008e880d-1e3d-4290-b25f-442ee1d90975\") " pod="kube-system/kas-connection-checker-685895c7c9-fvrpn"
Oct 30 02:55:31.419000 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.418970    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0155b708-711a-4794-9fd5-bd88e9cae690-tmp\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:31.419102 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419029    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sq96\" (UniqueName: \"kubernetes.io/projected/7eb43cf3-056c-4372-94b6-dc57ed47dd83-kube-api-access-7sq96\") pod \"network-check-source-6f78d59f99-v5ppj\" (UID: \"7eb43cf3-056c-4372-94b6-dc57ed47dd83\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-v5ppj"
Oct 30 02:55:31.419102 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419058    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-default-certificate\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:31.419102 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419076    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0155b708-711a-4794-9fd5-bd88e9cae690-serving-cert\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:31.419186 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419106    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-ca-trust-extracted\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.419186 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419168    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br65p\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-kube-api-access-br65p\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.419276 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419202    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9qsl\" (UniqueName: \"kubernetes.io/projected/deae1b40-455b-40fd-af9a-c9dfa727a018-kube-api-access-t9qsl\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:31.419276 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419224    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23e7ce26-ee23-41a7-a925-6fa7c29eda06-config\") pod \"console-operator-7cd56b8dbc-glqfz\" (UID: \"23e7ce26-ee23-41a7-a925-6fa7c29eda06\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:31.419276 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419267    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0155b708-711a-4794-9fd5-bd88e9cae690-service-ca-bundle\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:31.419366 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419316    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-installation-pull-secrets\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.419366 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419358    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ed3e2e45-04fe-4fe8-8e88-39439772c950-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz\" (UID: \"ed3e2e45-04fe-4fe8-8e88-39439772c950\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz"
Oct 30 02:55:31.419426 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419375    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-zw522\" (UID: \"4f3b466e-4894-448e-bc16-a106de5cb14d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:31.419426 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419420    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0155b708-711a-4794-9fd5-bd88e9cae690-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:31.419482 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-certificates\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.419482 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419453    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-stats-auth\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:31.419482 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419477    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3e2e45-04fe-4fe8-8e88-39439772c950-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz\" (UID: \"ed3e2e45-04fe-4fe8-8e88-39439772c950\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz"
Oct 30 02:55:31.419570 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419502    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0-config\") pod \"service-ca-operator-544d749c8c-7j4nj\" (UID: \"d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj"
Oct 30 02:55:31.419570 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419551    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23e7ce26-ee23-41a7-a925-6fa7c29eda06-trusted-ca\") pod \"console-operator-7cd56b8dbc-glqfz\" (UID: \"23e7ce26-ee23-41a7-a925-6fa7c29eda06\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:31.419627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419572    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0-serving-cert\") pod \"service-ca-operator-544d749c8c-7j4nj\" (UID: \"d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj"
Oct 30 02:55:31.419627 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419607    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-installation-pull-secrets\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.419702 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419624    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzd97\" (UniqueName: \"kubernetes.io/projected/51b2e157-f1a2-4630-aab9-9ddcd71d5bca-kube-api-access-kzd97\") pod \"kas-connection-checker-685895c7c9-sppcg\" (UID: \"51b2e157-f1a2-4630-aab9-9ddcd71d5bca\") " pod="kube-system/kas-connection-checker-685895c7c9-sppcg"
Oct 30 02:55:31.419702 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419655    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/05bcf726-e398-4201-b974-52406fbdc287-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-9d2rd\" (UID: \"05bcf726-e398-4201-b974-52406fbdc287\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:31.419756 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419678    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-trusted-ca\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.419756 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419727    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:31.419813 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419754    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-bound-sa-token\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.419813 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419786    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/05bcf726-e398-4201-b974-52406fbdc287-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-9d2rd\" (UID: \"05bcf726-e398-4201-b974-52406fbdc287\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:31.419898 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419813    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/744bf9e1-3e8b-402c-863a-331a6786f85c-nginx-conf\") pod \"networking-console-plugin-86c478bb88-jkkwx\" (UID: \"744bf9e1-3e8b-402c-863a-331a6786f85c\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"
Oct 30 02:55:31.419898 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419842    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.419898 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419870    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23e7ce26-ee23-41a7-a925-6fa7c29eda06-serving-cert\") pod \"console-operator-7cd56b8dbc-glqfz\" (UID: \"23e7ce26-ee23-41a7-a925-6fa7c29eda06\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:31.419898 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419887    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbqgb\" (UniqueName: \"kubernetes.io/projected/ed3e2e45-04fe-4fe8-8e88-39439772c950-kube-api-access-lbqgb\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz\" (UID: \"ed3e2e45-04fe-4fe8-8e88-39439772c950\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz"
Oct 30 02:55:31.420034 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419919    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jkkwx\" (UID: \"744bf9e1-3e8b-402c-863a-331a6786f85c\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"
Oct 30 02:55:31.420034 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419944    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-bound-sa-token\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.420034 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/45836983-c4ed-4083-886b-07e4c4264527-config-volume\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:31.420034 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.419989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g92lj\" (UniqueName: \"kubernetes.io/projected/05bcf726-e398-4201-b974-52406fbdc287-kube-api-access-g92lj\") pod \"cluster-monitoring-operator-884576c57-9d2rd\" (UID: \"05bcf726-e398-4201-b974-52406fbdc287\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:31.420034 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.420017    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26009c26-16bc-4e82-8246-ebf75fa644e9-cert\") pod \"ingress-canary-xqnbh\" (UID: \"26009c26-16bc-4e82-8246-ebf75fa644e9\") " pod="openshift-ingress-canary/ingress-canary-xqnbh"
Oct 30 02:55:31.420195 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.420036    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:31.420195 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.420059    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-image-registry-private-configuration\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.420195 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.420140    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94wx2\" (UniqueName: \"kubernetes.io/projected/f71c9dd2-5916-4cd5-9aea-6fd70a343419-kube-api-access-94wx2\") pod \"kas-connection-checker-685895c7c9-dtw44\" (UID: \"f71c9dd2-5916-4cd5-9aea-6fd70a343419\") " pod="kube-system/kas-connection-checker-685895c7c9-dtw44"
Oct 30 02:55:31.420195 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.420164    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8c9g\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-kube-api-access-t8c9g\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.420195 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.420180    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.420331 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.420198    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nzs8\" (UniqueName: \"kubernetes.io/projected/23e7ce26-ee23-41a7-a925-6fa7c29eda06-kube-api-access-8nzs8\") pod \"console-operator-7cd56b8dbc-glqfz\" (UID: \"23e7ce26-ee23-41a7-a925-6fa7c29eda06\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:31.420331 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.420220    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-metrics-certs\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:31.420331 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.420245    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-image-registry-private-configuration\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.420331 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.420263    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-trusted-ca\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.420331 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.420295    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7p4v\" (UniqueName: \"kubernetes.io/projected/26009c26-16bc-4e82-8246-ebf75fa644e9-kube-api-access-n7p4v\") pod \"ingress-canary-xqnbh\" (UID: \"26009c26-16bc-4e82-8246-ebf75fa644e9\") " pod="openshift-ingress-canary/ingress-canary-xqnbh"
Oct 30 02:55:31.420526 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.420335    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0155b708-711a-4794-9fd5-bd88e9cae690-snapshots\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:31.420526 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.420353    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k98hn\" (UniqueName: \"kubernetes.io/projected/45836983-c4ed-4083-886b-07e4c4264527-kube-api-access-k98hn\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:31.420526 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.420379    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4hvv\" (UniqueName: \"kubernetes.io/projected/6aa78c16-a2a2-4a61-adb7-575224b8ac6f-kube-api-access-c4hvv\") pod \"volume-data-source-validator-58c9f5f46d-cxwq4\" (UID: \"6aa78c16-a2a2-4a61-adb7-575224b8ac6f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cxwq4"
Oct 30 02:55:31.420526 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.420402    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g2pl\" (UniqueName: \"kubernetes.io/projected/0155b708-711a-4794-9fd5-bd88e9cae690-kube-api-access-8g2pl\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:31.420526 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.420417    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45836983-c4ed-4083-886b-07e4c4264527-tmp-dir\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:31.420526 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.420445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-zw522\" (UID: \"4f3b466e-4894-448e-bc16-a106de5cb14d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:31.420526 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.420484    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9nkd\" (UniqueName: \"kubernetes.io/projected/4f3b466e-4894-448e-bc16-a106de5cb14d-kube-api-access-j9nkd\") pod \"cluster-samples-operator-6ddb6c8b94-zw522\" (UID: \"4f3b466e-4894-448e-bc16-a106de5cb14d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:31.420526 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.420509    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-ca-trust-extracted\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.521290 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521218    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23e7ce26-ee23-41a7-a925-6fa7c29eda06-serving-cert\") pod \"console-operator-7cd56b8dbc-glqfz\" (UID: \"23e7ce26-ee23-41a7-a925-6fa7c29eda06\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:31.521290 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbqgb\" (UniqueName: \"kubernetes.io/projected/ed3e2e45-04fe-4fe8-8e88-39439772c950-kube-api-access-lbqgb\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz\" (UID: \"ed3e2e45-04fe-4fe8-8e88-39439772c950\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz"
Oct 30 02:55:31.521290 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521278    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jkkwx\" (UID: \"744bf9e1-3e8b-402c-863a-331a6786f85c\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"
Oct 30 02:55:31.521534 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521294    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-bound-sa-token\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.521534 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521312    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/45836983-c4ed-4083-886b-07e4c4264527-config-volume\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:31.521534 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g92lj\" (UniqueName: \"kubernetes.io/projected/05bcf726-e398-4201-b974-52406fbdc287-kube-api-access-g92lj\") pod \"cluster-monitoring-operator-884576c57-9d2rd\" (UID: \"05bcf726-e398-4201-b974-52406fbdc287\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:31.521534 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521355    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26009c26-16bc-4e82-8246-ebf75fa644e9-cert\") pod \"ingress-canary-xqnbh\" (UID: \"26009c26-16bc-4e82-8246-ebf75fa644e9\") " pod="openshift-ingress-canary/ingress-canary-xqnbh"
Oct 30 02:55:31.521534 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:31.521365    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 02:55:31.521534 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:31.521430    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert podName:744bf9e1-3e8b-402c-863a-331a6786f85c nodeName:}" failed. No retries permitted until 2026-10-30 02:55:32.021410121 +0000 UTC m=+30.574918341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-jkkwx" (UID: "744bf9e1-3e8b-402c-863a-331a6786f85c") : secret "networking-console-plugin-cert" not found
Oct 30 02:55:31.521534 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:31.521454    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle podName:deae1b40-455b-40fd-af9a-c9dfa727a018 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:32.021440778 +0000 UTC m=+30.574948997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle") pod "router-default-67f9ffd857-gnqzw" (UID: "deae1b40-455b-40fd-af9a-c9dfa727a018") : configmap references non-existent config key: service-ca.crt
Oct 30 02:55:31.521921 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521370    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:31.521921 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521576    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-image-registry-private-configuration\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.521921 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521613    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94wx2\" (UniqueName: \"kubernetes.io/projected/f71c9dd2-5916-4cd5-9aea-6fd70a343419-kube-api-access-94wx2\") pod \"kas-connection-checker-685895c7c9-dtw44\" (UID: \"f71c9dd2-5916-4cd5-9aea-6fd70a343419\") " pod="kube-system/kas-connection-checker-685895c7c9-dtw44"
Oct 30 02:55:31.521921 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521636    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8c9g\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-kube-api-access-t8c9g\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.521921 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521658    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.521921 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521682    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nzs8\" (UniqueName: \"kubernetes.io/projected/23e7ce26-ee23-41a7-a925-6fa7c29eda06-kube-api-access-8nzs8\") pod \"console-operator-7cd56b8dbc-glqfz\" (UID: \"23e7ce26-ee23-41a7-a925-6fa7c29eda06\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:31.521921 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521727    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-metrics-certs\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:31.521921 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-image-registry-private-configuration\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.521921 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521779    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-trusted-ca\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.521921 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521801    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7p4v\" (UniqueName: \"kubernetes.io/projected/26009c26-16bc-4e82-8246-ebf75fa644e9-kube-api-access-n7p4v\") pod \"ingress-canary-xqnbh\" (UID: \"26009c26-16bc-4e82-8246-ebf75fa644e9\") " pod="openshift-ingress-canary/ingress-canary-xqnbh"
Oct 30 02:55:31.521921 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0155b708-711a-4794-9fd5-bd88e9cae690-snapshots\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:31.521921 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521849    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k98hn\" (UniqueName: \"kubernetes.io/projected/45836983-c4ed-4083-886b-07e4c4264527-kube-api-access-k98hn\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:31.521921 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521879    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4hvv\" (UniqueName: \"kubernetes.io/projected/6aa78c16-a2a2-4a61-adb7-575224b8ac6f-kube-api-access-c4hvv\") pod \"volume-data-source-validator-58c9f5f46d-cxwq4\" (UID: \"6aa78c16-a2a2-4a61-adb7-575224b8ac6f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cxwq4"
Oct 30 02:55:31.521921 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521905    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g2pl\" (UniqueName: \"kubernetes.io/projected/0155b708-711a-4794-9fd5-bd88e9cae690-kube-api-access-8g2pl\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:31.521921 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521928    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45836983-c4ed-4083-886b-07e4c4264527-tmp-dir\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:31.522533 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:31.521972    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 02:55:31.522533 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:31.522020    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-metrics-certs podName:deae1b40-455b-40fd-af9a-c9dfa727a018 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:32.022005952 +0000 UTC m=+30.575514174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-metrics-certs") pod "router-default-67f9ffd857-gnqzw" (UID: "deae1b40-455b-40fd-af9a-c9dfa727a018") : secret "router-metrics-certs-default" not found
Oct 30 02:55:31.522533 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521971    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/45836983-c4ed-4083-886b-07e4c4264527-config-volume\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:31.522533 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:31.522054    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 02:55:31.522533 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:31.522094    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-tls podName:4f3b466e-4894-448e-bc16-a106de5cb14d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:32.022079956 +0000 UTC m=+30.575588194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-zw522" (UID: "4f3b466e-4894-448e-bc16-a106de5cb14d") : secret "samples-operator-tls" not found
Oct 30 02:55:31.522533 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:31.522092    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:31.522533 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:31.522107    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b8cd6f65-mwg8n: secret "image-registry-tls" not found
Oct 30 02:55:31.522533 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:31.522133    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls podName:8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:32.022124665 +0000 UTC m=+30.575632868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls") pod "image-registry-57b8cd6f65-mwg8n" (UID: "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d") : secret "image-registry-tls" not found
Oct 30 02:55:31.522533 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.521972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-zw522\" (UID: \"4f3b466e-4894-448e-bc16-a106de5cb14d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:31.522533 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522318    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9nkd\" (UniqueName: \"kubernetes.io/projected/4f3b466e-4894-448e-bc16-a106de5cb14d-kube-api-access-j9nkd\") pod \"cluster-samples-operator-6ddb6c8b94-zw522\" (UID: \"4f3b466e-4894-448e-bc16-a106de5cb14d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:31.522533 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522357    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-ca-trust-extracted\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.522533 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522398    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-certificates\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.522533 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522429    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncgfc\" (UniqueName: \"kubernetes.io/projected/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0-kube-api-access-ncgfc\") pod \"service-ca-operator-544d749c8c-7j4nj\" (UID: \"d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj"
Oct 30 02:55:31.522533 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znv57\" (UniqueName: \"kubernetes.io/projected/008e880d-1e3d-4290-b25f-442ee1d90975-kube-api-access-znv57\") pod \"kas-connection-checker-685895c7c9-fvrpn\" (UID: \"008e880d-1e3d-4290-b25f-442ee1d90975\") " pod="kube-system/kas-connection-checker-685895c7c9-fvrpn"
Oct 30 02:55:31.522533 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522478    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0155b708-711a-4794-9fd5-bd88e9cae690-tmp\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:31.522533 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522523    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sq96\" (UniqueName: \"kubernetes.io/projected/7eb43cf3-056c-4372-94b6-dc57ed47dd83-kube-api-access-7sq96\") pod \"network-check-source-6f78d59f99-v5ppj\" (UID: \"7eb43cf3-056c-4372-94b6-dc57ed47dd83\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-v5ppj"
Oct 30 02:55:31.523273 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522564    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-default-certificate\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:31.523273 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522591    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0155b708-711a-4794-9fd5-bd88e9cae690-serving-cert\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:31.523273 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522615    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-ca-trust-extracted\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.523273 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522645    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br65p\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-kube-api-access-br65p\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.523273 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522666    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9qsl\" (UniqueName: \"kubernetes.io/projected/deae1b40-455b-40fd-af9a-c9dfa727a018-kube-api-access-t9qsl\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:31.523273 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522703    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23e7ce26-ee23-41a7-a925-6fa7c29eda06-config\") pod \"console-operator-7cd56b8dbc-glqfz\" (UID: \"23e7ce26-ee23-41a7-a925-6fa7c29eda06\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:31.523273 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522726    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0155b708-711a-4794-9fd5-bd88e9cae690-service-ca-bundle\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:31.523273 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522761    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-installation-pull-secrets\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.523273 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522798    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ed3e2e45-04fe-4fe8-8e88-39439772c950-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz\" (UID: \"ed3e2e45-04fe-4fe8-8e88-39439772c950\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz"
Oct 30 02:55:31.523273 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-zw522\" (UID: \"4f3b466e-4894-448e-bc16-a106de5cb14d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:31.523273 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522857    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0155b708-711a-4794-9fd5-bd88e9cae690-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:31.523273 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522884    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-certificates\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.523273 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522908    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-stats-auth\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:31.523273 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522939    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3e2e45-04fe-4fe8-8e88-39439772c950-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz\" (UID: \"ed3e2e45-04fe-4fe8-8e88-39439772c950\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz"
Oct 30 02:55:31.523273 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522966    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0-config\") pod \"service-ca-operator-544d749c8c-7j4nj\" (UID: \"d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj"
Oct 30 02:55:31.523273 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.522994    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23e7ce26-ee23-41a7-a925-6fa7c29eda06-trusted-ca\") pod \"console-operator-7cd56b8dbc-glqfz\" (UID: \"23e7ce26-ee23-41a7-a925-6fa7c29eda06\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:31.524063 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.523018    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0-serving-cert\") pod \"service-ca-operator-544d749c8c-7j4nj\" (UID: \"d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj"
Oct 30 02:55:31.524063 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.523063    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0155b708-711a-4794-9fd5-bd88e9cae690-snapshots\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:31.524063 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.523076    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-installation-pull-secrets\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.524063 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.523110    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzd97\" (UniqueName: \"kubernetes.io/projected/51b2e157-f1a2-4630-aab9-9ddcd71d5bca-kube-api-access-kzd97\") pod \"kas-connection-checker-685895c7c9-sppcg\" (UID: \"51b2e157-f1a2-4630-aab9-9ddcd71d5bca\") " pod="kube-system/kas-connection-checker-685895c7c9-sppcg"
Oct 30 02:55:31.524063 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.523141    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/05bcf726-e398-4201-b974-52406fbdc287-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-9d2rd\" (UID: \"05bcf726-e398-4201-b974-52406fbdc287\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:31.524063 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.523167    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-trusted-ca\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.524063 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.523179    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45836983-c4ed-4083-886b-07e4c4264527-tmp-dir\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:31.524063 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.523193    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:31.524063 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.523232    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-bound-sa-token\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.524063 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:31.523270    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 02:55:31.524063 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.523273    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/05bcf726-e398-4201-b974-52406fbdc287-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-9d2rd\" (UID: \"05bcf726-e398-4201-b974-52406fbdc287\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:31.524063 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.523300    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/744bf9e1-3e8b-402c-863a-331a6786f85c-nginx-conf\") pod \"networking-console-plugin-86c478bb88-jkkwx\" (UID: \"744bf9e1-3e8b-402c-863a-331a6786f85c\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"
Oct 30 02:55:31.524063 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:31.523318    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls podName:45836983-c4ed-4083-886b-07e4c4264527 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:32.023298255 +0000 UTC m=+30.576806472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls") pod "dns-default-ftq8q" (UID: "45836983-c4ed-4083-886b-07e4c4264527") : secret "dns-default-metrics-tls" not found
Oct 30 02:55:31.524063 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.523348    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.524063 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.523655    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-trusted-ca\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.524063 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.523772    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-ca-trust-extracted\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.524063 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:31.523860    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:31.524841 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:31.523873    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88cb97fb-qnc8x: secret "image-registry-tls" not found
Oct 30 02:55:31.524841 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:31.523911    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls podName:80f1930a-aa7c-46a0-9a4c-95f35539bf4c nodeName:}" failed. No retries permitted until 2026-10-30 02:55:32.0238976 +0000 UTC m=+30.577405820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls") pod "image-registry-88cb97fb-qnc8x" (UID: "80f1930a-aa7c-46a0-9a4c-95f35539bf4c") : secret "image-registry-tls" not found
Oct 30 02:55:31.524841 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.523977    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/744bf9e1-3e8b-402c-863a-331a6786f85c-nginx-conf\") pod \"networking-console-plugin-86c478bb88-jkkwx\" (UID: \"744bf9e1-3e8b-402c-863a-331a6786f85c\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"
Oct 30 02:55:31.524841 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.524222    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23e7ce26-ee23-41a7-a925-6fa7c29eda06-config\") pod \"console-operator-7cd56b8dbc-glqfz\" (UID: \"23e7ce26-ee23-41a7-a925-6fa7c29eda06\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:31.524841 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.524325    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-certificates\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.524841 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.524771    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0-config\") pod \"service-ca-operator-544d749c8c-7j4nj\" (UID: \"d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj"
Oct 30 02:55:31.525113 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.524970    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0155b708-711a-4794-9fd5-bd88e9cae690-tmp\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:31.525352 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:31.524261    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:31.525454 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:31.525438    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05bcf726-e398-4201-b974-52406fbdc287-cluster-monitoring-operator-tls podName:05bcf726-e398-4201-b974-52406fbdc287 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:32.025421478 +0000 UTC m=+30.578929685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/05bcf726-e398-4201-b974-52406fbdc287-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-9d2rd" (UID: "05bcf726-e398-4201-b974-52406fbdc287") : secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:31.525755 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.525732    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-image-registry-private-configuration\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.525839 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.525764    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26009c26-16bc-4e82-8246-ebf75fa644e9-cert\") pod \"ingress-canary-xqnbh\" (UID: \"26009c26-16bc-4e82-8246-ebf75fa644e9\") " pod="openshift-ingress-canary/ingress-canary-xqnbh"
Oct 30 02:55:31.526370 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.526344    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-ca-trust-extracted\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.527195 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.526896    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-trusted-ca\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.527195 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.526946    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/05bcf726-e398-4201-b974-52406fbdc287-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-9d2rd\" (UID: \"05bcf726-e398-4201-b974-52406fbdc287\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:31.527195 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.527020    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23e7ce26-ee23-41a7-a925-6fa7c29eda06-trusted-ca\") pod \"console-operator-7cd56b8dbc-glqfz\" (UID: \"23e7ce26-ee23-41a7-a925-6fa7c29eda06\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:31.527424 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.527344    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0155b708-711a-4794-9fd5-bd88e9cae690-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:31.527424 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.527388    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0155b708-711a-4794-9fd5-bd88e9cae690-service-ca-bundle\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:31.527840 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.527545    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3e2e45-04fe-4fe8-8e88-39439772c950-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz\" (UID: \"ed3e2e45-04fe-4fe8-8e88-39439772c950\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz"
Oct 30 02:55:31.527840 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.527573    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-certificates\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.527840 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.527682    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23e7ce26-ee23-41a7-a925-6fa7c29eda06-serving-cert\") pod \"console-operator-7cd56b8dbc-glqfz\" (UID: \"23e7ce26-ee23-41a7-a925-6fa7c29eda06\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:31.528128 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.528107    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ed3e2e45-04fe-4fe8-8e88-39439772c950-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz\" (UID: \"ed3e2e45-04fe-4fe8-8e88-39439772c950\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz"
Oct 30 02:55:31.528205 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.528183    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0-serving-cert\") pod \"service-ca-operator-544d749c8c-7j4nj\" (UID: \"d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj"
Oct 30 02:55:31.528329 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.528311    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-zw522\" (UID: \"4f3b466e-4894-448e-bc16-a106de5cb14d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:31.529600 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.529580    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-default-certificate\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:31.529837 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.529815    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-image-registry-private-configuration\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.530149 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.530122    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0155b708-711a-4794-9fd5-bd88e9cae690-serving-cert\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:31.530149 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.530141    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-installation-pull-secrets\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.530364 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.530346    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-stats-auth\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:31.530879 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.530863    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-installation-pull-secrets\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.545153 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.545126    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbqgb\" (UniqueName: \"kubernetes.io/projected/ed3e2e45-04fe-4fe8-8e88-39439772c950-kube-api-access-lbqgb\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz\" (UID: \"ed3e2e45-04fe-4fe8-8e88-39439772c950\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz"
Oct 30 02:55:31.545553 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.545535    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-bound-sa-token\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.545601 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.545548    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g92lj\" (UniqueName: \"kubernetes.io/projected/05bcf726-e398-4201-b974-52406fbdc287-kube-api-access-g92lj\") pod \"cluster-monitoring-operator-884576c57-9d2rd\" (UID: \"05bcf726-e398-4201-b974-52406fbdc287\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:31.550415 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.550392    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9qsl\" (UniqueName: \"kubernetes.io/projected/deae1b40-455b-40fd-af9a-c9dfa727a018-kube-api-access-t9qsl\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:31.551157 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.551117    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9nkd\" (UniqueName: \"kubernetes.io/projected/4f3b466e-4894-448e-bc16-a106de5cb14d-kube-api-access-j9nkd\") pod \"cluster-samples-operator-6ddb6c8b94-zw522\" (UID: \"4f3b466e-4894-448e-bc16-a106de5cb14d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:31.551544 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.551524    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nzs8\" (UniqueName: \"kubernetes.io/projected/23e7ce26-ee23-41a7-a925-6fa7c29eda06-kube-api-access-8nzs8\") pod \"console-operator-7cd56b8dbc-glqfz\" (UID: \"23e7ce26-ee23-41a7-a925-6fa7c29eda06\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:31.551669 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.551647    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7p4v\" (UniqueName: \"kubernetes.io/projected/26009c26-16bc-4e82-8246-ebf75fa644e9-kube-api-access-n7p4v\") pod \"ingress-canary-xqnbh\" (UID: \"26009c26-16bc-4e82-8246-ebf75fa644e9\") " pod="openshift-ingress-canary/ingress-canary-xqnbh"
Oct 30 02:55:31.551990 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.551971    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g2pl\" (UniqueName: \"kubernetes.io/projected/0155b708-711a-4794-9fd5-bd88e9cae690-kube-api-access-8g2pl\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:31.552217 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.552201    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4hvv\" (UniqueName: \"kubernetes.io/projected/6aa78c16-a2a2-4a61-adb7-575224b8ac6f-kube-api-access-c4hvv\") pod \"volume-data-source-validator-58c9f5f46d-cxwq4\" (UID: \"6aa78c16-a2a2-4a61-adb7-575224b8ac6f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cxwq4"
Oct 30 02:55:31.555928 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.555903    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8c9g\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-kube-api-access-t8c9g\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.556147 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.556129    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br65p\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-kube-api-access-br65p\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:31.556604 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.556577    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncgfc\" (UniqueName: \"kubernetes.io/projected/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0-kube-api-access-ncgfc\") pod \"service-ca-operator-544d749c8c-7j4nj\" (UID: \"d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj"
Oct 30 02:55:31.556708 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.556585    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znv57\" (UniqueName: \"kubernetes.io/projected/008e880d-1e3d-4290-b25f-442ee1d90975-kube-api-access-znv57\") pod \"kas-connection-checker-685895c7c9-fvrpn\" (UID: \"008e880d-1e3d-4290-b25f-442ee1d90975\") " pod="kube-system/kas-connection-checker-685895c7c9-fvrpn"
Oct 30 02:55:31.556766 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.556718    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sq96\" (UniqueName: \"kubernetes.io/projected/7eb43cf3-056c-4372-94b6-dc57ed47dd83-kube-api-access-7sq96\") pod \"network-check-source-6f78d59f99-v5ppj\" (UID: \"7eb43cf3-056c-4372-94b6-dc57ed47dd83\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-v5ppj"
Oct 30 02:55:31.556853 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.556833    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzd97\" (UniqueName: \"kubernetes.io/projected/51b2e157-f1a2-4630-aab9-9ddcd71d5bca-kube-api-access-kzd97\") pod \"kas-connection-checker-685895c7c9-sppcg\" (UID: \"51b2e157-f1a2-4630-aab9-9ddcd71d5bca\") " pod="kube-system/kas-connection-checker-685895c7c9-sppcg"
Oct 30 02:55:31.557149 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.557131    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94wx2\" (UniqueName: \"kubernetes.io/projected/f71c9dd2-5916-4cd5-9aea-6fd70a343419-kube-api-access-94wx2\") pod \"kas-connection-checker-685895c7c9-dtw44\" (UID: \"f71c9dd2-5916-4cd5-9aea-6fd70a343419\") " pod="kube-system/kas-connection-checker-685895c7c9-dtw44"
Oct 30 02:55:31.557716 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.557678    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-bound-sa-token\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:31.562062 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.562044    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k98hn\" (UniqueName: \"kubernetes.io/projected/45836983-c4ed-4083-886b-07e4c4264527-kube-api-access-k98hn\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:31.574062 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.574046    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-dtw44"
Oct 30 02:55:31.579968 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.579925    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-fvrpn"
Oct 30 02:55:31.587032 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.587012    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-sppcg"
Oct 30 02:55:31.596352 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.596300    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:31.629325 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.629283    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:31.630598 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.630575    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj"
Oct 30 02:55:31.638361 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.638337    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cxwq4"
Oct 30 02:55:31.653014 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.652994    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:31.670724 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.670702    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-v5ppj"
Oct 30 02:55:31.690611 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.687996    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz"
Oct 30 02:55:31.693232 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.693090    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xqnbh"
Oct 30 02:55:31.893038 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.893008    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:31.901809 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.901785    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-dtw44"]
Oct 30 02:55:31.906870 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.906848    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-sppcg"]
Oct 30 02:55:31.909670 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.909639    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-kss29"]
Oct 30 02:55:31.909963 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:31.909941    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf71c9dd2_5916_4cd5_9aea_6fd70a343419.slice/crio-ef5630f247014f6c0303f33a21202ff1d65f9c65095993b0b32e9e20e2ddeb17 WatchSource:0}: Error finding container ef5630f247014f6c0303f33a21202ff1d65f9c65095993b0b32e9e20e2ddeb17: Status 404 returned error can't find the container with id ef5630f247014f6c0303f33a21202ff1d65f9c65095993b0b32e9e20e2ddeb17
Oct 30 02:55:31.911452 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:31.911417    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b2e157_f1a2_4630_aab9_9ddcd71d5bca.slice/crio-7237b50f031cfcbf825d6c015d550fc8cad95978348c6526707ea3a73720c739 WatchSource:0}: Error finding container 7237b50f031cfcbf825d6c015d550fc8cad95978348c6526707ea3a73720c739: Status 404 returned error can't find the container with id 7237b50f031cfcbf825d6c015d550fc8cad95978348c6526707ea3a73720c739
Oct 30 02:55:31.914232 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:31.914213    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0155b708_711a_4794_9fd5_bd88e9cae690.slice/crio-6864fedfd19107c47747bbb25dd14d8697817daf0cadb4d28bab06c419dc512c WatchSource:0}: Error finding container 6864fedfd19107c47747bbb25dd14d8697817daf0cadb4d28bab06c419dc512c: Status 404 returned error can't find the container with id 6864fedfd19107c47747bbb25dd14d8697817daf0cadb4d28bab06c419dc512c
Oct 30 02:55:31.921119 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.921095    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-fvrpn"]
Oct 30 02:55:31.928175 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:31.928143    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod008e880d_1e3d_4290_b25f_442ee1d90975.slice/crio-21996c845836702ed6c2c3c3db3f67ad5a8ea3ede4128a0d662f4f818c8ae444 WatchSource:0}: Error finding container 21996c845836702ed6c2c3c3db3f67ad5a8ea3ede4128a0d662f4f818c8ae444: Status 404 returned error can't find the container with id 21996c845836702ed6c2c3c3db3f67ad5a8ea3ede4128a0d662f4f818c8ae444
Oct 30 02:55:31.955524 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:31.955493    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj"]
Oct 30 02:55:31.961134 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:31.961105    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6cf63fd_2c9b_449d_9fe4_a2503f33a1c0.slice/crio-cd0e21a5b2653ff2f9f41714d6ea22b66bc398b93436c108d038fd657a0186a6 WatchSource:0}: Error finding container cd0e21a5b2653ff2f9f41714d6ea22b66bc398b93436c108d038fd657a0186a6: Status 404 returned error can't find the container with id cd0e21a5b2653ff2f9f41714d6ea22b66bc398b93436c108d038fd657a0186a6
Oct 30 02:55:32.030984 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.030933    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:32.031070 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.030990    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/05bcf726-e398-4201-b974-52406fbdc287-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-9d2rd\" (UID: \"05bcf726-e398-4201-b974-52406fbdc287\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:32.031070 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.031016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:32.031070 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.031053    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jkkwx\" (UID: \"744bf9e1-3e8b-402c-863a-331a6786f85c\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"
Oct 30 02:55:32.031203 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.031084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:32.031203 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:32.031087    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 02:55:32.031203 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:32.031129    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:32.031203 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:32.031143    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88cb97fb-qnc8x: secret "image-registry-tls" not found
Oct 30 02:55:32.031203 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:32.031163    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls podName:45836983-c4ed-4083-886b-07e4c4264527 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:33.031147197 +0000 UTC m=+31.584655418 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls") pod "dns-default-ftq8q" (UID: "45836983-c4ed-4083-886b-07e4c4264527") : secret "dns-default-metrics-tls" not found
Oct 30 02:55:32.031203 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:32.031102    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:32.031203 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:32.031185    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls podName:80f1930a-aa7c-46a0-9a4c-95f35539bf4c nodeName:}" failed. No retries permitted until 2026-10-30 02:55:33.031169867 +0000 UTC m=+31.584678082 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls") pod "image-registry-88cb97fb-qnc8x" (UID: "80f1930a-aa7c-46a0-9a4c-95f35539bf4c") : secret "image-registry-tls" not found
Oct 30 02:55:32.031203 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:32.031185    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 02:55:32.031203 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:32.031199    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle podName:deae1b40-455b-40fd-af9a-c9dfa727a018 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:33.031192653 +0000 UTC m=+31.584700855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle") pod "router-default-67f9ffd857-gnqzw" (UID: "deae1b40-455b-40fd-af9a-c9dfa727a018") : configmap references non-existent config key: service-ca.crt
Oct 30 02:55:32.031620 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.031217    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:32.031620 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:32.031241    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert podName:744bf9e1-3e8b-402c-863a-331a6786f85c nodeName:}" failed. No retries permitted until 2026-10-30 02:55:33.031223673 +0000 UTC m=+31.584731878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-jkkwx" (UID: "744bf9e1-3e8b-402c-863a-331a6786f85c") : secret "networking-console-plugin-cert" not found
Oct 30 02:55:32.031620 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:32.031263    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:32.031620 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:32.031270    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b8cd6f65-mwg8n: secret "image-registry-tls" not found
Oct 30 02:55:32.031620 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:32.031274    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05bcf726-e398-4201-b974-52406fbdc287-cluster-monitoring-operator-tls podName:05bcf726-e398-4201-b974-52406fbdc287 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:33.031263057 +0000 UTC m=+31.584771265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/05bcf726-e398-4201-b974-52406fbdc287-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-9d2rd" (UID: "05bcf726-e398-4201-b974-52406fbdc287") : secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:32.031620 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:32.031291    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls podName:8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:33.031284276 +0000 UTC m=+31.584792479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls") pod "image-registry-57b8cd6f65-mwg8n" (UID: "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d") : secret "image-registry-tls" not found
Oct 30 02:55:32.031620 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.031319    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-metrics-certs\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:32.031620 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.031351    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-zw522\" (UID: \"4f3b466e-4894-448e-bc16-a106de5cb14d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:32.031620 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:32.031409    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 02:55:32.031620 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:32.031448    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-metrics-certs podName:deae1b40-455b-40fd-af9a-c9dfa727a018 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:33.031436396 +0000 UTC m=+31.584944605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-metrics-certs") pod "router-default-67f9ffd857-gnqzw" (UID: "deae1b40-455b-40fd-af9a-c9dfa727a018") : secret "router-metrics-certs-default" not found
Oct 30 02:55:32.031620 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:32.031456    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 02:55:32.031620 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:32.031490    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-tls podName:4f3b466e-4894-448e-bc16-a106de5cb14d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:33.031481094 +0000 UTC m=+31.584989326 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-zw522" (UID: "4f3b466e-4894-448e-bc16-a106de5cb14d") : secret "samples-operator-tls" not found
Oct 30 02:55:32.037312 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.037291    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cxwq4"]
Oct 30 02:55:32.073272 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.073241    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-glqfz"]
Oct 30 02:55:32.074962 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.074942    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xqnbh"]
Oct 30 02:55:32.077423 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:32.077393    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23e7ce26_ee23_41a7_a925_6fa7c29eda06.slice/crio-6cb67bd48c780dda9552e1d4ccb9e78dc8341eeaa952f1adf1a62f7a9e7e65a4 WatchSource:0}: Error finding container 6cb67bd48c780dda9552e1d4ccb9e78dc8341eeaa952f1adf1a62f7a9e7e65a4: Status 404 returned error can't find the container with id 6cb67bd48c780dda9552e1d4ccb9e78dc8341eeaa952f1adf1a62f7a9e7e65a4
Oct 30 02:55:32.079985 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:32.079947    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26009c26_16bc_4e82_8246_ebf75fa644e9.slice/crio-d1b3d2596525e49f953ae23b99aaf64f553e9f05aa5204f59e815cf2848edf68 WatchSource:0}: Error finding container d1b3d2596525e49f953ae23b99aaf64f553e9f05aa5204f59e815cf2848edf68: Status 404 returned error can't find the container with id d1b3d2596525e49f953ae23b99aaf64f553e9f05aa5204f59e815cf2848edf68
Oct 30 02:55:32.091454 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.091436    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-v5ppj"]
Oct 30 02:55:32.092667 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.092639    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:32.096365 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:32.096342    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb43cf3_056c_4372_94b6_dc57ed47dd83.slice/crio-3bca95cdd0fe0019dcf1a867b9567196b2fa927a598208b1c7ee6d85c9f8add1 WatchSource:0}: Error finding container 3bca95cdd0fe0019dcf1a867b9567196b2fa927a598208b1c7ee6d85c9f8add1: Status 404 returned error can't find the container with id 3bca95cdd0fe0019dcf1a867b9567196b2fa927a598208b1c7ee6d85c9f8add1
Oct 30 02:55:32.115556 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.115532    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz"]
Oct 30 02:55:32.120064 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:32.120040    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded3e2e45_04fe_4fe8_8e88_39439772c950.slice/crio-c75ec095347bb169c5b0a9e4c9189a081527e23173b7fca5b424138db80e58a0 WatchSource:0}: Error finding container c75ec095347bb169c5b0a9e4c9189a081527e23173b7fca5b424138db80e58a0: Status 404 returned error can't find the container with id c75ec095347bb169c5b0a9e4c9189a081527e23173b7fca5b424138db80e58a0
Oct 30 02:55:32.129245 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.129224    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj" event={"ID":"d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0","Type":"ContainerStarted","Data":"cd0e21a5b2653ff2f9f41714d6ea22b66bc398b93436c108d038fd657a0186a6"}
Oct 30 02:55:32.130324 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.130306    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-kss29" event={"ID":"0155b708-711a-4794-9fd5-bd88e9cae690","Type":"ContainerStarted","Data":"6864fedfd19107c47747bbb25dd14d8697817daf0cadb4d28bab06c419dc512c"}
Oct 30 02:55:32.131405 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.131387    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz" event={"ID":"23e7ce26-ee23-41a7-a925-6fa7c29eda06","Type":"ContainerStarted","Data":"6cb67bd48c780dda9552e1d4ccb9e78dc8341eeaa952f1adf1a62f7a9e7e65a4"}
Oct 30 02:55:32.132745 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.132721    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-sppcg" event={"ID":"51b2e157-f1a2-4630-aab9-9ddcd71d5bca","Type":"ContainerStarted","Data":"e0370b8871bf3277bcf56fed7ab5b10c8c81dc9748a0672f3fe58c8a7c74a219"}
Oct 30 02:55:32.132849 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.132767    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-sppcg" event={"ID":"51b2e157-f1a2-4630-aab9-9ddcd71d5bca","Type":"ContainerStarted","Data":"7237b50f031cfcbf825d6c015d550fc8cad95978348c6526707ea3a73720c739"}
Oct 30 02:55:32.135074 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.135055    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-fvrpn" event={"ID":"008e880d-1e3d-4290-b25f-442ee1d90975","Type":"ContainerStarted","Data":"c231b717a2439355a68be87f9ef4d3330624c2c1309c8b7b1f1aeae9353d87ec"}
Oct 30 02:55:32.135157 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.135091    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-fvrpn" event={"ID":"008e880d-1e3d-4290-b25f-442ee1d90975","Type":"ContainerStarted","Data":"21996c845836702ed6c2c3c3db3f67ad5a8ea3ede4128a0d662f4f818c8ae444"}
Oct 30 02:55:32.136496 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.136475    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xqnbh" event={"ID":"26009c26-16bc-4e82-8246-ebf75fa644e9","Type":"ContainerStarted","Data":"d1b3d2596525e49f953ae23b99aaf64f553e9f05aa5204f59e815cf2848edf68"}
Oct 30 02:55:32.137584 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.137565    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cxwq4" event={"ID":"6aa78c16-a2a2-4a61-adb7-575224b8ac6f","Type":"ContainerStarted","Data":"36e82d5fcd9df33692ef6adb14fd67afaa8a0f2166a649081984668c37cc9841"}
Oct 30 02:55:32.138620 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.138600    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz" event={"ID":"ed3e2e45-04fe-4fe8-8e88-39439772c950","Type":"ContainerStarted","Data":"c75ec095347bb169c5b0a9e4c9189a081527e23173b7fca5b424138db80e58a0"}
Oct 30 02:55:32.139885 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.139860    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-dtw44" event={"ID":"f71c9dd2-5916-4cd5-9aea-6fd70a343419","Type":"ContainerStarted","Data":"97d877ade8ee44cb5c487ab9dfad0495e0baf6fc4dbfa99756189a81f66e8481"}
Oct 30 02:55:32.139967 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.139907    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-dtw44" event={"ID":"f71c9dd2-5916-4cd5-9aea-6fd70a343419","Type":"ContainerStarted","Data":"ef5630f247014f6c0303f33a21202ff1d65f9c65095993b0b32e9e20e2ddeb17"}
Oct 30 02:55:32.140946 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.140927    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-v5ppj" event={"ID":"7eb43cf3-056c-4372-94b6-dc57ed47dd83","Type":"ContainerStarted","Data":"3bca95cdd0fe0019dcf1a867b9567196b2fa927a598208b1c7ee6d85c9f8add1"}
Oct 30 02:55:32.173379 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.173338    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-sppcg" podStartSLOduration=367.173295786 podStartE2EDuration="6m7.173295786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:49:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:32.172942906 +0000 UTC m=+30.726451130" watchObservedRunningTime="2026-10-30 02:55:32.173295786 +0000 UTC m=+30.726804057"
Oct 30 02:55:32.216515 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.216473    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-dtw44" podStartSLOduration=367.216458586 podStartE2EDuration="6m7.216458586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:49:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:32.215386239 +0000 UTC m=+30.768894464" watchObservedRunningTime="2026-10-30 02:55:32.216458586 +0000 UTC m=+30.769966812"
Oct 30 02:55:32.258251 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.258203    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-fvrpn" podStartSLOduration=367.258191733 podStartE2EDuration="6m7.258191733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:49:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:32.257361622 +0000 UTC m=+30.810869857" watchObservedRunningTime="2026-10-30 02:55:32.258191733 +0000 UTC m=+30.811699959"
Oct 30 02:55:32.269068 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.269046    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:32.861211 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.859398    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:32.861211 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.860033    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:32.861211 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.860446    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:32.879790 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.879469    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 02:55:32.879790 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.879550    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lqw84\""
Oct 30 02:55:32.879790 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.879640    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-s7n2w\""
Oct 30 02:55:32.879790 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.879666    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 02:55:32.879790 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:32.879739    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-pchn6\""
Oct 30 02:55:33.041561 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:33.041531    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:33.042023 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:33.041586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-metrics-certs\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:33.042023 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:33.041648    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-zw522\" (UID: \"4f3b466e-4894-448e-bc16-a106de5cb14d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:33.042023 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:33.041804    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 02:55:33.042023 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:33.041844    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:33.042023 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:33.041863    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b8cd6f65-mwg8n: secret "image-registry-tls" not found
Oct 30 02:55:33.042297 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:33.042044    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 02:55:33.042297 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:33.042179    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-metrics-certs podName:deae1b40-455b-40fd-af9a-c9dfa727a018 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.042157465 +0000 UTC m=+33.595665678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-metrics-certs") pod "router-default-67f9ffd857-gnqzw" (UID: "deae1b40-455b-40fd-af9a-c9dfa727a018") : secret "router-metrics-certs-default" not found
Oct 30 02:55:33.042297 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:33.042205    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls podName:8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.042195126 +0000 UTC m=+33.595703332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls") pod "image-registry-57b8cd6f65-mwg8n" (UID: "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d") : secret "image-registry-tls" not found
Oct 30 02:55:33.042297 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:33.042224    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-tls podName:4f3b466e-4894-448e-bc16-a106de5cb14d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.042214163 +0000 UTC m=+33.595722423 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-zw522" (UID: "4f3b466e-4894-448e-bc16-a106de5cb14d") : secret "samples-operator-tls" not found
Oct 30 02:55:33.042512 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:33.042320    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:33.042512 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:33.042350    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/05bcf726-e398-4201-b974-52406fbdc287-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-9d2rd\" (UID: \"05bcf726-e398-4201-b974-52406fbdc287\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:33.042512 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:33.042382    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:33.042512 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:33.042428    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jkkwx\" (UID: \"744bf9e1-3e8b-402c-863a-331a6786f85c\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"
Oct 30 02:55:33.042512 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:33.042457    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:33.042760 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:33.042581    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle podName:deae1b40-455b-40fd-af9a-c9dfa727a018 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.042568564 +0000 UTC m=+33.596076803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle") pod "router-default-67f9ffd857-gnqzw" (UID: "deae1b40-455b-40fd-af9a-c9dfa727a018") : configmap references non-existent config key: service-ca.crt
Oct 30 02:55:33.042760 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:33.042645    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 02:55:33.042760 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:33.042677    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls podName:45836983-c4ed-4083-886b-07e4c4264527 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.042666919 +0000 UTC m=+33.596175137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls") pod "dns-default-ftq8q" (UID: "45836983-c4ed-4083-886b-07e4c4264527") : secret "dns-default-metrics-tls" not found
Oct 30 02:55:33.042760 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:33.042745    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:33.042958 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:33.042777    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05bcf726-e398-4201-b974-52406fbdc287-cluster-monitoring-operator-tls podName:05bcf726-e398-4201-b974-52406fbdc287 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.042766888 +0000 UTC m=+33.596275093 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/05bcf726-e398-4201-b974-52406fbdc287-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-9d2rd" (UID: "05bcf726-e398-4201-b974-52406fbdc287") : secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:33.042958 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:33.042833    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:33.042958 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:33.042843    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88cb97fb-qnc8x: secret "image-registry-tls" not found
Oct 30 02:55:33.042958 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:33.042871    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls podName:80f1930a-aa7c-46a0-9a4c-95f35539bf4c nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.042861677 +0000 UTC m=+33.596369895 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls") pod "image-registry-88cb97fb-qnc8x" (UID: "80f1930a-aa7c-46a0-9a4c-95f35539bf4c") : secret "image-registry-tls" not found
Oct 30 02:55:33.042958 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:33.042921    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 02:55:33.042958 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:33.042961    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert podName:744bf9e1-3e8b-402c-863a-331a6786f85c nodeName:}" failed. No retries permitted until 2026-10-30 02:55:35.042941446 +0000 UTC m=+33.596449652 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-jkkwx" (UID: "744bf9e1-3e8b-402c-863a-331a6786f85c") : secret "networking-console-plugin-cert" not found
Oct 30 02:55:33.057463 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:33.057403    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:35.064852 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:35.064813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-zw522\" (UID: \"4f3b466e-4894-448e-bc16-a106de5cb14d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:35.065338 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:35.064960    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 02:55:35.065338 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:35.065016    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 02:55:35.065338 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:35.065030    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-tls podName:4f3b466e-4894-448e-bc16-a106de5cb14d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:39.065010493 +0000 UTC m=+37.618518716 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-zw522" (UID: "4f3b466e-4894-448e-bc16-a106de5cb14d") : secret "samples-operator-tls" not found
Oct 30 02:55:35.065338 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:35.065048    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls podName:45836983-c4ed-4083-886b-07e4c4264527 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:39.065038259 +0000 UTC m=+37.618546478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls") pod "dns-default-ftq8q" (UID: "45836983-c4ed-4083-886b-07e4c4264527") : secret "dns-default-metrics-tls" not found
Oct 30 02:55:35.065338 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:35.064958    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:35.065338 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:35.065079    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/05bcf726-e398-4201-b974-52406fbdc287-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-9d2rd\" (UID: \"05bcf726-e398-4201-b974-52406fbdc287\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:35.065338 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:35.065105    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:35.065338 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:35.065146    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jkkwx\" (UID: \"744bf9e1-3e8b-402c-863a-331a6786f85c\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"
Oct 30 02:55:35.065338 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:35.065188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:35.065338 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:35.065225    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:35.065338 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:35.065252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-metrics-certs\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:35.065976 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:35.065347    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 02:55:35.065976 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:35.065392    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-metrics-certs podName:deae1b40-455b-40fd-af9a-c9dfa727a018 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:39.065377889 +0000 UTC m=+37.618886113 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-metrics-certs") pod "router-default-67f9ffd857-gnqzw" (UID: "deae1b40-455b-40fd-af9a-c9dfa727a018") : secret "router-metrics-certs-default" not found
Oct 30 02:55:35.065976 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:35.065432    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 02:55:35.065976 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:35.065460    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle podName:deae1b40-455b-40fd-af9a-c9dfa727a018 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:39.065449766 +0000 UTC m=+37.618957984 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle") pod "router-default-67f9ffd857-gnqzw" (UID: "deae1b40-455b-40fd-af9a-c9dfa727a018") : configmap references non-existent config key: service-ca.crt
Oct 30 02:55:35.065976 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:35.065477    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert podName:744bf9e1-3e8b-402c-863a-331a6786f85c nodeName:}" failed. No retries permitted until 2026-10-30 02:55:39.065468296 +0000 UTC m=+37.618976502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-jkkwx" (UID: "744bf9e1-3e8b-402c-863a-331a6786f85c") : secret "networking-console-plugin-cert" not found
Oct 30 02:55:35.065976 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:35.065500    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:35.065976 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:35.065532    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05bcf726-e398-4201-b974-52406fbdc287-cluster-monitoring-operator-tls podName:05bcf726-e398-4201-b974-52406fbdc287 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:39.065522274 +0000 UTC m=+37.619030494 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/05bcf726-e398-4201-b974-52406fbdc287-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-9d2rd" (UID: "05bcf726-e398-4201-b974-52406fbdc287") : secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:35.065976 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:35.065535    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:35.065976 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:35.065546    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b8cd6f65-mwg8n: secret "image-registry-tls" not found
Oct 30 02:55:35.065976 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:35.065577    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls podName:8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:39.065568047 +0000 UTC m=+37.619076265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls") pod "image-registry-57b8cd6f65-mwg8n" (UID: "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d") : secret "image-registry-tls" not found
Oct 30 02:55:35.065976 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:35.065582    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:35.065976 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:35.065591    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88cb97fb-qnc8x: secret "image-registry-tls" not found
Oct 30 02:55:35.065976 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:35.065611    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls podName:80f1930a-aa7c-46a0-9a4c-95f35539bf4c nodeName:}" failed. No retries permitted until 2026-10-30 02:55:39.065605869 +0000 UTC m=+37.619114077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls") pod "image-registry-88cb97fb-qnc8x" (UID: "80f1930a-aa7c-46a0-9a4c-95f35539bf4c") : secret "image-registry-tls" not found
Oct 30 02:55:35.155680 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:35.155633    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cxwq4" event={"ID":"6aa78c16-a2a2-4a61-adb7-575224b8ac6f","Type":"ContainerStarted","Data":"49ca0741302ccd0a763bf611f889fd6fc57fc72c3ff57e5e6d422c7cd006d8c4"}
Oct 30 02:55:35.397131 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:35.397018    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:35.578993 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:35.578808    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:35.674080 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:35.673996    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:35.674080 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:35.674058    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs\") pod \"network-metrics-daemon-zxzxk\" (UID: \"e7a138e6-2485-4134-9d3a-c2419d154f30\") " pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:35.674249 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:35.674188    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 02:55:35.674249 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:35.674243    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs podName:e7a138e6-2485-4134-9d3a-c2419d154f30 nodeName:}" failed. No retries permitted until 2026-10-30 02:56:07.674222942 +0000 UTC m=+66.227731146 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs") pod "network-metrics-daemon-zxzxk" (UID: "e7a138e6-2485-4134-9d3a-c2419d154f30") : secret "metrics-daemon-secret" not found
Oct 30 02:55:35.684308 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:35.684279    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:35.774628 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:35.774502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drz2l\" (UniqueName: \"kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l\") pod \"network-check-target-p7mkl\" (UID: \"46ab1416-b4cf-4b29-b8b3-38fdf77db001\") " pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:35.784050 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:35.778074    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drz2l\" (UniqueName: \"kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l\") pod \"network-check-target-p7mkl\" (UID: \"46ab1416-b4cf-4b29-b8b3-38fdf77db001\") " pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:35.899209 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:35.899184    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:35.922645 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:35.922617    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:36.161539 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:36.161094    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-kss29" event={"ID":"0155b708-711a-4794-9fd5-bd88e9cae690","Type":"ContainerStarted","Data":"058dcea2605047d8ef1e3e5127ec625213ae3dfcba96a1cd38e764611c55ec44"}
Oct 30 02:55:36.205479 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:36.205360    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cxwq4" podStartSLOduration=345.957296252 podStartE2EDuration="5m48.205339457s" totalImagesPullingTime="2.248043205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:35.196912719 +0000 UTC m=+33.750420969" watchObservedRunningTime="2026-10-30 02:55:36.205339457 +0000 UTC m=+34.758847696"
Oct 30 02:55:36.206207 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:36.206165    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-kss29" podStartSLOduration=346.328335206 podStartE2EDuration="5m50.206150485s" totalImagesPullingTime="3.877815279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:36.204218405 +0000 UTC m=+34.757726632" watchObservedRunningTime="2026-10-30 02:55:36.206150485 +0000 UTC m=+34.759658713"
Oct 30 02:55:36.256719 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:36.252112    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lg4vm"]
Oct 30 02:55:36.256719 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:36.256650    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf785b5c4_7dd0_4f7b_9980_e1146f9bbdfc.slice/crio-2cd490b988c362cbb893489ce14566b048da22c844d6cfbcc1fbb8c201cec6e7 WatchSource:0}: Error finding container 2cd490b988c362cbb893489ce14566b048da22c844d6cfbcc1fbb8c201cec6e7: Status 404 returned error can't find the container with id 2cd490b988c362cbb893489ce14566b048da22c844d6cfbcc1fbb8c201cec6e7
Oct 30 02:55:36.277284 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:36.277264    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p7mkl"]
Oct 30 02:55:36.282737 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:36.282679    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ab1416_b4cf_4b29_b8b3_38fdf77db001.slice/crio-3ab3592f705d0766da0a3e81cd5d84aceb2aecd36fdc10c0d137ff9ba0fcb1ec WatchSource:0}: Error finding container 3ab3592f705d0766da0a3e81cd5d84aceb2aecd36fdc10c0d137ff9ba0fcb1ec: Status 404 returned error can't find the container with id 3ab3592f705d0766da0a3e81cd5d84aceb2aecd36fdc10c0d137ff9ba0fcb1ec
Oct 30 02:55:36.964562 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:36.964530    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9jzff"]
Oct 30 02:55:36.977783 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:36.977750    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:36.988072 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:36.988041    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:36.988201 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:36.988089    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-data-volume\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:36.988201 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:36.988162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlm47\" (UniqueName: \"kubernetes.io/projected/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-api-access-mlm47\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:36.988469 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:36.988268    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:36.988469 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:36.988354    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-crio-socket\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:36.990488 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:36.990465    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9jzff"]
Oct 30 02:55:37.001464 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.000626    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 02:55:37.001464 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.001322    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 02:55:37.001464 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.001439    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ndvn4\""
Oct 30 02:55:37.034774 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.034751    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-bf2qb-x5rb9"]
Oct 30 02:55:37.053470 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.053448    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:37.058987 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.058914    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-bf2qb-x5rb9"]
Oct 30 02:55:37.089352 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.089308    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:37.089459 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.089408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-crio-socket\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:37.089459 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.089444    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-archives-path\") pod \"periodic-gathering-bf2qb-x5rb9\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") " pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:37.089580 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:37.089476    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:37.089580 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:37.089527    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 02:55:37.089580 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:37.089539    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls podName:b1eeaa36-b8dc-4f8a-81f4-54b22848135d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:37.589519142 +0000 UTC m=+36.143027361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9jzff" (UID: "b1eeaa36-b8dc-4f8a-81f4-54b22848135d") : secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:37.089580 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:37.089578    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-rbac-proxy-cm podName:b1eeaa36-b8dc-4f8a-81f4-54b22848135d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:37.589562873 +0000 UTC m=+36.143071081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9jzff" (UID: "b1eeaa36-b8dc-4f8a-81f4-54b22848135d") : configmap "kube-rbac-proxy" not found
Oct 30 02:55:37.089826 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.089633    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-crio-socket\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:37.089826 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.089474    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:37.089826 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.089719    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-data-volume\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:37.089826 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.089782    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-trusted-ca-bundle\") pod \"periodic-gathering-bf2qb-x5rb9\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") " pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:37.089826 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.089810    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlm47\" (UniqueName: \"kubernetes.io/projected/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-api-access-mlm47\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:37.090188 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.089842    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-service-ca-bundle\") pod \"periodic-gathering-bf2qb-x5rb9\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") " pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:37.090188 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.089910    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb76r\" (UniqueName: \"kubernetes.io/projected/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-kube-api-access-jb76r\") pod \"periodic-gathering-bf2qb-x5rb9\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") " pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:37.090188 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.089992    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-data-volume\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:37.093392 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.093371    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dfxcf\""
Oct 30 02:55:37.099922 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.099802    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:37.113533 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.113510    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlm47\" (UniqueName: \"kubernetes.io/projected/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-api-access-mlm47\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:37.167001 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.166976    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/0.log"
Oct 30 02:55:37.167293 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.167009    2576 generic.go:356] "Generic (PLEG): container finished" podID="23e7ce26-ee23-41a7-a925-6fa7c29eda06" containerID="186ea43ff858d9c245f13c27f92f571b5a2b192e72efa95e704e9400c20193e4" exitCode=255
Oct 30 02:55:37.167293 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.167083    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz" event={"ID":"23e7ce26-ee23-41a7-a925-6fa7c29eda06","Type":"ContainerDied","Data":"186ea43ff858d9c245f13c27f92f571b5a2b192e72efa95e704e9400c20193e4"}
Oct 30 02:55:37.167365 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.167349    2576 scope.go:122] "RemoveContainer" containerID="186ea43ff858d9c245f13c27f92f571b5a2b192e72efa95e704e9400c20193e4"
Oct 30 02:55:37.169920 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.169895    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p7mkl" event={"ID":"46ab1416-b4cf-4b29-b8b3-38fdf77db001","Type":"ContainerStarted","Data":"3ab3592f705d0766da0a3e81cd5d84aceb2aecd36fdc10c0d137ff9ba0fcb1ec"}
Oct 30 02:55:37.179621 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.179598    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lg4vm" event={"ID":"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc","Type":"ContainerStarted","Data":"2cd490b988c362cbb893489ce14566b048da22c844d6cfbcc1fbb8c201cec6e7"}
Oct 30 02:55:37.196470 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.190414    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-archives-path\") pod \"periodic-gathering-bf2qb-x5rb9\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") " pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:37.196470 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.190511    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-trusted-ca-bundle\") pod \"periodic-gathering-bf2qb-x5rb9\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") " pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:37.196470 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.190565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-service-ca-bundle\") pod \"periodic-gathering-bf2qb-x5rb9\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") " pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:37.196470 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.190631    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb76r\" (UniqueName: \"kubernetes.io/projected/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-kube-api-access-jb76r\") pod \"periodic-gathering-bf2qb-x5rb9\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") " pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:37.196470 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.190824    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-archives-path\") pod \"periodic-gathering-bf2qb-x5rb9\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") " pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:37.196470 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.191823    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-service-ca-bundle\") pod \"periodic-gathering-bf2qb-x5rb9\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") " pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:37.196470 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.191883    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-trusted-ca-bundle\") pod \"periodic-gathering-bf2qb-x5rb9\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") " pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:37.221764 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.221740    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb76r\" (UniqueName: \"kubernetes.io/projected/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-kube-api-access-jb76r\") pod \"periodic-gathering-bf2qb-x5rb9\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") " pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:37.272706 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.270562    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:37.379406 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.379214    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:37.595017 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.594817    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:37.595017 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.594924    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:37.595201 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:37.595034    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:37.595201 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:37.595117    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls podName:b1eeaa36-b8dc-4f8a-81f4-54b22848135d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:38.595095644 +0000 UTC m=+37.148603866 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9jzff" (UID: "b1eeaa36-b8dc-4f8a-81f4-54b22848135d") : secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:37.595433 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:37.595348    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 02:55:37.595433 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:37.595410    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-rbac-proxy-cm podName:b1eeaa36-b8dc-4f8a-81f4-54b22848135d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:38.595394473 +0000 UTC m=+37.148902698 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9jzff" (UID: "b1eeaa36-b8dc-4f8a-81f4-54b22848135d") : configmap "kube-rbac-proxy" not found
Oct 30 02:55:37.909423 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:37.909389    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-bf2qb-x5rb9"]
Oct 30 02:55:38.187022 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.186923    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz" event={"ID":"ed3e2e45-04fe-4fe8-8e88-39439772c950","Type":"ContainerStarted","Data":"c268ff1a443001b61cb123310d2f2e22acbd2108942ffc7cc754255d5c448cd8"}
Oct 30 02:55:38.191159 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.191123    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-bf2qb-x5rb9" event={"ID":"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc","Type":"ContainerStarted","Data":"dfd67a3d37523d05cd2698d2d39365ff380eb40adc61364a34c339633d6a018e"}
Oct 30 02:55:38.191288 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.191181    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-bf2qb-x5rb9" event={"ID":"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc","Type":"ContainerStarted","Data":"93de7f62dfb50c8fdd6431acbf6e83b5eeb451c7f6dd09d9443832a3961acf08"}
Oct 30 02:55:38.193964 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.193935    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-v5ppj" event={"ID":"7eb43cf3-056c-4372-94b6-dc57ed47dd83","Type":"ContainerStarted","Data":"c8332533ae901c6c3d64b4b5484c691d40d2478d1ea28a7b3790c9cc6449367a"}
Oct 30 02:55:38.195970 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.195934    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj" event={"ID":"d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0","Type":"ContainerStarted","Data":"860393b61fd7c50de0085197dc82ea2f101b60f4dce6490cb946aa2024536587"}
Oct 30 02:55:38.198951 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.198929    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/1.log"
Oct 30 02:55:38.199536 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.199517    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/0.log"
Oct 30 02:55:38.199608 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.199555    2576 generic.go:356] "Generic (PLEG): container finished" podID="23e7ce26-ee23-41a7-a925-6fa7c29eda06" containerID="40feda09fb99d9862f6d8156d3ed4f38964693e1f22005c2ea9663219677ee9f" exitCode=255
Oct 30 02:55:38.199798 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.199775    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz" event={"ID":"23e7ce26-ee23-41a7-a925-6fa7c29eda06","Type":"ContainerDied","Data":"40feda09fb99d9862f6d8156d3ed4f38964693e1f22005c2ea9663219677ee9f"}
Oct 30 02:55:38.199859 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.199827    2576 scope.go:122] "RemoveContainer" containerID="186ea43ff858d9c245f13c27f92f571b5a2b192e72efa95e704e9400c20193e4"
Oct 30 02:55:38.199921 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.199902    2576 scope.go:122] "RemoveContainer" containerID="40feda09fb99d9862f6d8156d3ed4f38964693e1f22005c2ea9663219677ee9f"
Oct 30 02:55:38.200099 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:38.200077    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-glqfz_openshift-console-operator(23e7ce26-ee23-41a7-a925-6fa7c29eda06)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz" podUID="23e7ce26-ee23-41a7-a925-6fa7c29eda06"
Oct 30 02:55:38.205600 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.205579    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xqnbh" event={"ID":"26009c26-16bc-4e82-8246-ebf75fa644e9","Type":"ContainerStarted","Data":"70e5cec3be45e6ef56a2fd5b0693c66a263a3d383a3b0adb3a9671d6a9c81c72"}
Oct 30 02:55:38.231714 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.231133    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz" podStartSLOduration=352.328583543 podStartE2EDuration="5m57.23111928s" totalImagesPullingTime="4.902535737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:38.229914376 +0000 UTC m=+36.783422635" watchObservedRunningTime="2026-10-30 02:55:38.23111928 +0000 UTC m=+36.784627505"
Oct 30 02:55:38.321979 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.319528    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj" podStartSLOduration=352.26216361 podStartE2EDuration="5m57.319505283s" totalImagesPullingTime="5.057341673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:38.319436699 +0000 UTC m=+36.872944926" watchObservedRunningTime="2026-10-30 02:55:38.319505283 +0000 UTC m=+36.873013509"
Oct 30 02:55:38.321979 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.320857    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-bf2qb-x5rb9" podStartSLOduration=1.320844858 podStartE2EDuration="1.320844858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:55:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:38.27790018 +0000 UTC m=+36.831408406" watchObservedRunningTime="2026-10-30 02:55:38.320844858 +0000 UTC m=+36.874353067"
Oct 30 02:55:38.407243 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.407187    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-v5ppj" podStartSLOduration=322.901967346 podStartE2EDuration="5m28.407169372s" totalImagesPullingTime="5.505202026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:38.405880097 +0000 UTC m=+36.959388322" watchObservedRunningTime="2026-10-30 02:55:38.407169372 +0000 UTC m=+36.960677599"
Oct 30 02:55:38.456581 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.456478    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xqnbh" podStartSLOduration=2.5036275999999997 podStartE2EDuration="7.45645996s" totalImagesPullingTime="4.95283236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:38.455656559 +0000 UTC m=+37.009164785" watchObservedRunningTime="2026-10-30 02:55:38.45645996 +0000 UTC m=+37.009968187"
Oct 30 02:55:38.546861 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.546829    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-ql7f5"]
Oct 30 02:55:38.566857 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.566823    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:38.578911 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.578876    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-rrzgh"]
Oct 30 02:55:38.580371 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.580350    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-ql7f5"
Oct 30 02:55:38.593661 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.593634    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-ql7f5"]
Oct 30 02:55:38.593794 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.593757    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-rrzgh"
Oct 30 02:55:38.598916 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.598865    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-rrzgh"]
Oct 30 02:55:38.607479 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.607443    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-l5vxm\""
Oct 30 02:55:38.607723 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.607669    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:38.607833 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.607724    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:38.607833 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.607776    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 02:55:38.607833 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.607782    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww2rj\" (UniqueName: \"kubernetes.io/projected/ed43211b-ec42-4683-99a6-541bf0a09c7e-kube-api-access-ww2rj\") pod \"migrator-66df5d496b-rrzgh\" (UID: \"ed43211b-ec42-4683-99a6-541bf0a09c7e\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-rrzgh"
Oct 30 02:55:38.607833 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.607814    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:38.608033 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.607864    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhjmb\" (UniqueName: \"kubernetes.io/projected/ba0ccc16-d085-4d7f-8df5-e9194ba06f33-kube-api-access-dhjmb\") pod \"migrator-66df5d496b-ql7f5\" (UID: \"ba0ccc16-d085-4d7f-8df5-e9194ba06f33\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-ql7f5"
Oct 30 02:55:38.608033 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:38.607882    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:38.608033 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:38.607935    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls podName:b1eeaa36-b8dc-4f8a-81f4-54b22848135d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:40.607917262 +0000 UTC m=+39.161425479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9jzff" (UID: "b1eeaa36-b8dc-4f8a-81f4-54b22848135d") : secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:38.608033 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:38.607973    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 02:55:38.608033 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:38.608031    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-rbac-proxy-cm podName:b1eeaa36-b8dc-4f8a-81f4-54b22848135d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:40.608014407 +0000 UTC m=+39.161522628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9jzff" (UID: "b1eeaa36-b8dc-4f8a-81f4-54b22848135d") : configmap "kube-rbac-proxy" not found
Oct 30 02:55:38.709037 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.708957    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww2rj\" (UniqueName: \"kubernetes.io/projected/ed43211b-ec42-4683-99a6-541bf0a09c7e-kube-api-access-ww2rj\") pod \"migrator-66df5d496b-rrzgh\" (UID: \"ed43211b-ec42-4683-99a6-541bf0a09c7e\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-rrzgh"
Oct 30 02:55:38.709162 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.709038    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhjmb\" (UniqueName: \"kubernetes.io/projected/ba0ccc16-d085-4d7f-8df5-e9194ba06f33-kube-api-access-dhjmb\") pod \"migrator-66df5d496b-ql7f5\" (UID: \"ba0ccc16-d085-4d7f-8df5-e9194ba06f33\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-ql7f5"
Oct 30 02:55:38.733455 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.733219    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhjmb\" (UniqueName: \"kubernetes.io/projected/ba0ccc16-d085-4d7f-8df5-e9194ba06f33-kube-api-access-dhjmb\") pod \"migrator-66df5d496b-ql7f5\" (UID: \"ba0ccc16-d085-4d7f-8df5-e9194ba06f33\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-ql7f5"
Oct 30 02:55:38.733455 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.733404    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww2rj\" (UniqueName: \"kubernetes.io/projected/ed43211b-ec42-4683-99a6-541bf0a09c7e-kube-api-access-ww2rj\") pod \"migrator-66df5d496b-rrzgh\" (UID: \"ed43211b-ec42-4683-99a6-541bf0a09c7e\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-rrzgh"
Oct 30 02:55:38.746506 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.746430    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:38.908583 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.908551    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-ql7f5"
Oct 30 02:55:38.912703 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.912667    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:38.928021 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:38.927970    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-rrzgh"
Oct 30 02:55:39.114922 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.114891    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:39.115070 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.114936    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/05bcf726-e398-4201-b974-52406fbdc287-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-9d2rd\" (UID: \"05bcf726-e398-4201-b974-52406fbdc287\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:39.115070 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.114965    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:39.115070 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.115000    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jkkwx\" (UID: \"744bf9e1-3e8b-402c-863a-331a6786f85c\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"
Oct 30 02:55:39.115070 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.115028    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:39.115070 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:39.115058    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 02:55:39.115325 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:39.115131    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls podName:45836983-c4ed-4083-886b-07e4c4264527 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:47.115109906 +0000 UTC m=+45.668618115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls") pod "dns-default-ftq8q" (UID: "45836983-c4ed-4083-886b-07e4c4264527") : secret "dns-default-metrics-tls" not found
Oct 30 02:55:39.115325 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:39.115156    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:39.115325 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:39.115173    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b8cd6f65-mwg8n: secret "image-registry-tls" not found
Oct 30 02:55:39.115325 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:39.115222    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls podName:8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:47.115206086 +0000 UTC m=+45.668714307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls") pod "image-registry-57b8cd6f65-mwg8n" (UID: "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d") : secret "image-registry-tls" not found
Oct 30 02:55:39.115325 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:39.115303    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:39.115586 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:39.115333    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:39.115586 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:39.115342    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05bcf726-e398-4201-b974-52406fbdc287-cluster-monitoring-operator-tls podName:05bcf726-e398-4201-b974-52406fbdc287 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:47.115328037 +0000 UTC m=+45.668836253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/05bcf726-e398-4201-b974-52406fbdc287-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-9d2rd" (UID: "05bcf726-e398-4201-b974-52406fbdc287") : secret "cluster-monitoring-operator-tls" not found
Oct 30 02:55:39.115586 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:39.115345    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88cb97fb-qnc8x: secret "image-registry-tls" not found
Oct 30 02:55:39.115586 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:39.115385    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls podName:80f1930a-aa7c-46a0-9a4c-95f35539bf4c nodeName:}" failed. No retries permitted until 2026-10-30 02:55:47.115370595 +0000 UTC m=+45.668878801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls") pod "image-registry-88cb97fb-qnc8x" (UID: "80f1930a-aa7c-46a0-9a4c-95f35539bf4c") : secret "image-registry-tls" not found
Oct 30 02:55:39.115586 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:39.115414    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle podName:deae1b40-455b-40fd-af9a-c9dfa727a018 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:47.115403295 +0000 UTC m=+45.668911512 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle") pod "router-default-67f9ffd857-gnqzw" (UID: "deae1b40-455b-40fd-af9a-c9dfa727a018") : configmap references non-existent config key: service-ca.crt
Oct 30 02:55:39.115586 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.115065    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:39.115586 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:39.115435    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 02:55:39.115586 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.115457    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-metrics-certs\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:39.115586 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:39.115468    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert podName:744bf9e1-3e8b-402c-863a-331a6786f85c nodeName:}" failed. No retries permitted until 2026-10-30 02:55:47.115458235 +0000 UTC m=+45.668966441 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-jkkwx" (UID: "744bf9e1-3e8b-402c-863a-331a6786f85c") : secret "networking-console-plugin-cert" not found
Oct 30 02:55:39.115586 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:39.115516    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 02:55:39.115586 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.115521    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-zw522\" (UID: \"4f3b466e-4894-448e-bc16-a106de5cb14d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:39.115586 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:39.115548    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-metrics-certs podName:deae1b40-455b-40fd-af9a-c9dfa727a018 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:47.115538647 +0000 UTC m=+45.669046869 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-metrics-certs") pod "router-default-67f9ffd857-gnqzw" (UID: "deae1b40-455b-40fd-af9a-c9dfa727a018") : secret "router-metrics-certs-default" not found
Oct 30 02:55:39.115586 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:39.115589    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 02:55:39.116023 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:39.115619    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-tls podName:4f3b466e-4894-448e-bc16-a106de5cb14d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:47.115609414 +0000 UTC m=+45.669117620 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-zw522" (UID: "4f3b466e-4894-448e-bc16-a106de5cb14d") : secret "samples-operator-tls" not found
Oct 30 02:55:39.212147 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.212115    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/1.log"
Oct 30 02:55:39.213962 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.212994    2576 scope.go:122] "RemoveContainer" containerID="40feda09fb99d9862f6d8156d3ed4f38964693e1f22005c2ea9663219677ee9f"
Oct 30 02:55:39.213962 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:39.213185    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-glqfz_openshift-console-operator(23e7ce26-ee23-41a7-a925-6fa7c29eda06)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz" podUID="23e7ce26-ee23-41a7-a925-6fa7c29eda06"
Oct 30 02:55:39.247264 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.247198    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-ql7f5"]
Oct 30 02:55:39.253523 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:39.253500    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba0ccc16_d085_4d7f_8df5_e9194ba06f33.slice/crio-06860450ca218963d74725411ea817c87d93c19e434bf93bffa29145d69b59c3 WatchSource:0}: Error finding container 06860450ca218963d74725411ea817c87d93c19e434bf93bffa29145d69b59c3: Status 404 returned error can't find the container with id 06860450ca218963d74725411ea817c87d93c19e434bf93bffa29145d69b59c3
Oct 30 02:55:39.274871 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.274846    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-rrzgh"]
Oct 30 02:55:39.279422 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:39.279390    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded43211b_ec42_4683_99a6_541bf0a09c7e.slice/crio-0895874fbf1fcffa737c54a0d5c9ff50fd0c69844c66983cb6a20175342fa302 WatchSource:0}: Error finding container 0895874fbf1fcffa737c54a0d5c9ff50fd0c69844c66983cb6a20175342fa302: Status 404 returned error can't find the container with id 0895874fbf1fcffa737c54a0d5c9ff50fd0c69844c66983cb6a20175342fa302
Oct 30 02:55:39.346843 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.346811    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-2xft4"]
Oct 30 02:55:39.372811 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.372784    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-2xft4"]
Oct 30 02:55:39.372960 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.372898    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-2xft4"
Oct 30 02:55:39.389159 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.389137    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Oct 30 02:55:39.389367 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.389345    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Oct 30 02:55:39.389367 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.389363    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Oct 30 02:55:39.389524 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.389417    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-q2qrw\""
Oct 30 02:55:39.389524 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.389428    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Oct 30 02:55:39.418414 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.418390    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/16ef1049-ff3e-486a-b565-06aa545c8592-signing-key\") pod \"service-ca-5fffc97bdf-2xft4\" (UID: \"16ef1049-ff3e-486a-b565-06aa545c8592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-2xft4"
Oct 30 02:55:39.418594 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.418576    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/16ef1049-ff3e-486a-b565-06aa545c8592-signing-cabundle\") pod \"service-ca-5fffc97bdf-2xft4\" (UID: \"16ef1049-ff3e-486a-b565-06aa545c8592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-2xft4"
Oct 30 02:55:39.418654 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.418614    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w79xq\" (UniqueName: \"kubernetes.io/projected/16ef1049-ff3e-486a-b565-06aa545c8592-kube-api-access-w79xq\") pod \"service-ca-5fffc97bdf-2xft4\" (UID: \"16ef1049-ff3e-486a-b565-06aa545c8592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-2xft4"
Oct 30 02:55:39.519852 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.519783    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/16ef1049-ff3e-486a-b565-06aa545c8592-signing-key\") pod \"service-ca-5fffc97bdf-2xft4\" (UID: \"16ef1049-ff3e-486a-b565-06aa545c8592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-2xft4"
Oct 30 02:55:39.519988 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.519933    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/16ef1049-ff3e-486a-b565-06aa545c8592-signing-cabundle\") pod \"service-ca-5fffc97bdf-2xft4\" (UID: \"16ef1049-ff3e-486a-b565-06aa545c8592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-2xft4"
Oct 30 02:55:39.519988 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.519972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w79xq\" (UniqueName: \"kubernetes.io/projected/16ef1049-ff3e-486a-b565-06aa545c8592-kube-api-access-w79xq\") pod \"service-ca-5fffc97bdf-2xft4\" (UID: \"16ef1049-ff3e-486a-b565-06aa545c8592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-2xft4"
Oct 30 02:55:39.520659 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.520634    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/16ef1049-ff3e-486a-b565-06aa545c8592-signing-cabundle\") pod \"service-ca-5fffc97bdf-2xft4\" (UID: \"16ef1049-ff3e-486a-b565-06aa545c8592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-2xft4"
Oct 30 02:55:39.522406 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.522376    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/16ef1049-ff3e-486a-b565-06aa545c8592-signing-key\") pod \"service-ca-5fffc97bdf-2xft4\" (UID: \"16ef1049-ff3e-486a-b565-06aa545c8592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-2xft4"
Oct 30 02:55:39.544379 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.544357    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w79xq\" (UniqueName: \"kubernetes.io/projected/16ef1049-ff3e-486a-b565-06aa545c8592-kube-api-access-w79xq\") pod \"service-ca-5fffc97bdf-2xft4\" (UID: \"16ef1049-ff3e-486a-b565-06aa545c8592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-2xft4"
Oct 30 02:55:39.701003 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.700979    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-2xft4"
Oct 30 02:55:39.848999 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:39.848895    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:40.024472 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:40.024437    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-2xft4"]
Oct 30 02:55:40.027612 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:40.027526    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:40.030064 ip-10-0-139-40 kubenswrapper[2576]: W1030 02:55:40.030022    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ef1049_ff3e_486a_b565_06aa545c8592.slice/crio-2d2206cb145dac70a5c592f4ba5f28d6819fd23f085595e6de3db9b205101f76 WatchSource:0}: Error finding container 2d2206cb145dac70a5c592f4ba5f28d6819fd23f085595e6de3db9b205101f76: Status 404 returned error can't find the container with id 2d2206cb145dac70a5c592f4ba5f28d6819fd23f085595e6de3db9b205101f76
Oct 30 02:55:40.217504 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:40.217405    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-rrzgh" event={"ID":"ed43211b-ec42-4683-99a6-541bf0a09c7e","Type":"ContainerStarted","Data":"0895874fbf1fcffa737c54a0d5c9ff50fd0c69844c66983cb6a20175342fa302"}
Oct 30 02:55:40.219603 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:40.219577    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-ql7f5" event={"ID":"ba0ccc16-d085-4d7f-8df5-e9194ba06f33","Type":"ContainerStarted","Data":"06860450ca218963d74725411ea817c87d93c19e434bf93bffa29145d69b59c3"}
Oct 30 02:55:40.222332 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:40.221252    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p7mkl" event={"ID":"46ab1416-b4cf-4b29-b8b3-38fdf77db001","Type":"ContainerStarted","Data":"50b9561460dd7d184cbf7e8c1bbeef015a061df45f7f13ae1fe8d2b1866faa13"}
Oct 30 02:55:40.222332 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:40.222019    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:40.224586 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:40.224121    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-2xft4" event={"ID":"16ef1049-ff3e-486a-b565-06aa545c8592","Type":"ContainerStarted","Data":"a3f7eb307a9dc93ffbd8e7d6dc38df1312574c0ba07afd27ef7b6aea79ba9f44"}
Oct 30 02:55:40.224586 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:40.224161    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-2xft4" event={"ID":"16ef1049-ff3e-486a-b565-06aa545c8592","Type":"ContainerStarted","Data":"2d2206cb145dac70a5c592f4ba5f28d6819fd23f085595e6de3db9b205101f76"}
Oct 30 02:55:40.308862 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:40.308323    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p7mkl" podStartSLOduration=35.028799673 podStartE2EDuration="38.308308453s" totalImagesPullingTime="3.27950878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:40.263628486 +0000 UTC m=+38.817136713" watchObservedRunningTime="2026-10-30 02:55:40.308308453 +0000 UTC m=+38.861816701"
Oct 30 02:55:40.310622 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:40.310238    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-2xft4" podStartSLOduration=1.310227716 podStartE2EDuration="1.310227716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:55:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:40.308413003 +0000 UTC m=+38.861921246" watchObservedRunningTime="2026-10-30 02:55:40.310227716 +0000 UTC m=+38.863735942"
Oct 30 02:55:40.498678 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:40.498640    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:40.631658 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:40.631623    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:40.631833 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:40.631767    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 02:55:40.631833 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:40.631797    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:40.631963 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:40.631843    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-rbac-proxy-cm podName:b1eeaa36-b8dc-4f8a-81f4-54b22848135d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:44.631823005 +0000 UTC m=+43.185331208 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9jzff" (UID: "b1eeaa36-b8dc-4f8a-81f4-54b22848135d") : configmap "kube-rbac-proxy" not found
Oct 30 02:55:40.631963 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:40.631895    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:40.631963 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:40.631955    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls podName:b1eeaa36-b8dc-4f8a-81f4-54b22848135d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:44.631939783 +0000 UTC m=+43.185448008 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9jzff" (UID: "b1eeaa36-b8dc-4f8a-81f4-54b22848135d") : secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:41.044040 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:41.044011    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:41.230323 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:41.230280    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-ql7f5" event={"ID":"ba0ccc16-d085-4d7f-8df5-e9194ba06f33","Type":"ContainerStarted","Data":"582a160b62094dbbe8aa08dc4467df6f8fd9d08175901004e076b8c1f6723d23"}
Oct 30 02:55:41.231949 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:41.231921    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-rrzgh" event={"ID":"ed43211b-ec42-4683-99a6-541bf0a09c7e","Type":"ContainerStarted","Data":"6fceea1f240c6903065319a1b1a16adffcc34c970dcba180524a3c014f5ab84c"}
Oct 30 02:55:41.254384 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:41.254322    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:41.275930 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:41.275883    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-ql7f5" podStartSLOduration=1.521877132 podStartE2EDuration="3.275865563s" totalImagesPullingTime="1.753988431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:41.275073297 +0000 UTC m=+39.828581576" watchObservedRunningTime="2026-10-30 02:55:41.275865563 +0000 UTC m=+39.829373788"
Oct 30 02:55:41.317543 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:41.316192    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-rrzgh" podStartSLOduration=1.5911387129999999 podStartE2EDuration="3.31617867s" totalImagesPullingTime="1.725039957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:55:41.315806754 +0000 UTC m=+39.869315008" watchObservedRunningTime="2026-10-30 02:55:41.31617867 +0000 UTC m=+39.869686895"
Oct 30 02:55:41.427301 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:41.427263    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:41.600560 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:41.600481    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:41.663729 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:41.663677    2576 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:41.663883 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:41.663758    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:41.664127 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:41.664107    2576 scope.go:122] "RemoveContainer" containerID="40feda09fb99d9862f6d8156d3ed4f38964693e1f22005c2ea9663219677ee9f"
Oct 30 02:55:41.664326 ip-10-0-139-40 kubenswrapper[2576]: E1030 02:55:41.664301    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-glqfz_openshift-console-operator(23e7ce26-ee23-41a7-a925-6fa7c29eda06)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz" podUID="23e7ce26-ee23-41a7-a925-6fa7c29eda06"
Oct 30 02:55:41.700132 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:41.700097    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ttjnv_322fa146-852c-4aca-a334-e9ba4e23d8ad/dns-node-resolver/0.log"
Oct 30 02:55:42.548071 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:42.548042    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:42.697174 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:42.697146    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s8pxs_dec5346e-cd73-40b5-bcf4-05bc1a7e33e2/node-ca/0.log"
Oct 30 02:55:42.774252 ip-10-0-139-40 kubenswrapper[2576]: I1030 02:55:42.774220    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:42.846902 ip-10-0-139-40 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 02:55:42.865110 ip-10-0-139-40 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 02:55:42.865274 ip-10-0-139-40 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 02:55:42.865322 ip-10-0-139-40 systemd[1]: kubelet.service: Consumed 3.184s CPU time.
Oct 30 02:55:42.880428 ip-10-0-139-40 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 02:55:42.980996 ip-10-0-139-40 kubenswrapper[5068]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 02:55:42.980996 ip-10-0-139-40 kubenswrapper[5068]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 02:55:42.980996 ip-10-0-139-40 kubenswrapper[5068]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 02:55:42.980996 ip-10-0-139-40 kubenswrapper[5068]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 02:55:42.984083 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.983993    5068 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:42.984083 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984076    5068 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:42.984083 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984081    5068 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:42.984083 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984084    5068 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:42.984083 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984087    5068 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:42.984083 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984090    5068 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:42.984083 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984093    5068 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:42.984348 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984096    5068 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:42.984348 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984099    5068 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:42.984348 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984102    5068 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:42.984348 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984105    5068 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:42.984348 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984108    5068 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:42.984348 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984111    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:42.984348 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984113    5068 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:42.984348 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984116    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:42.984348 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984119    5068 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:42.984348 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984121    5068 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:42.984348 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984124    5068 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:42.984348 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984127    5068 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:42.984348 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984129    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:42.984348 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984137    5068 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:42.984348 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984140    5068 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:42.984348 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984143    5068 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:42.984348 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984146    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:42.984348 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984149    5068 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:42.984348 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984151    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:42.984829 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984154    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:42.984829 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984156    5068 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:42.984829 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984159    5068 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:42.984829 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984162    5068 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:42.984829 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984164    5068 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:42.984829 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984167    5068 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:42.984829 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984169    5068 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:42.984829 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984172    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:42.984829 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984175    5068 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:42.984829 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984177    5068 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:42.984829 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984180    5068 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:42.984829 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984184    5068 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:42.984829 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984188    5068 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:42.984829 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984192    5068 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:42.984829 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984195    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:42.984829 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984198    5068 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:42.984829 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984201    5068 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:42.984829 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984204    5068 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:42.984829 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984206    5068 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:42.985299 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984209    5068 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:42.985299 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984211    5068 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:42.985299 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984214    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:42.985299 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984217    5068 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:42.985299 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984219    5068 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:42.985299 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984222    5068 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:42.985299 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984225    5068 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:42.985299 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984228    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:42.985299 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984230    5068 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:42.985299 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984233    5068 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:42.985299 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984235    5068 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:42.985299 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984238    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:42.985299 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984240    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:42.985299 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984243    5068 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:42.985299 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984246    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:42.985299 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984249    5068 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:42.985299 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984251    5068 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:42.985299 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984253    5068 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:42.985299 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984256    5068 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:42.985770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984258    5068 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:42.985770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984261    5068 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:42.985770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984264    5068 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:42.985770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984267    5068 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:42.985770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984270    5068 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:42.985770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984272    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:42.985770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984275    5068 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:42.985770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984278    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:42.985770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984281    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:42.985770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984283    5068 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:42.985770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984286    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:42.985770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984288    5068 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:42.985770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984291    5068 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:42.985770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984293    5068 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:42.985770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984297    5068 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:42.985770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984300    5068 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:42.985770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984303    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:42.985770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984305    5068 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:42.985770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984308    5068 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:42.985770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984312    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:42.986255 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984314    5068 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:42.986255 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984317    5068 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:42.986255 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984319    5068 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:42.986255 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984322    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:42.986255 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984325    5068 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:42.986255 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984328    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:42.986255 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984331    5068 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:42.986255 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984334    5068 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:42.986255 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984336    5068 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:42.986255 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984339    5068 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:42.986255 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984342    5068 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:42.986255 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984344    5068 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:42.986255 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984347    5068 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:42.986255 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984350    5068 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:42.986255 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984353    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:42.986255 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984356    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:42.986255 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984361    5068 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:42.986255 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984366    5068 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:42.986255 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984369    5068 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:42.986858 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984372    5068 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:42.986858 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984375    5068 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:42.986858 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.984377    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:42.986858 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985139    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:42.986858 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985147    5068 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:42.986858 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985150    5068 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:42.986858 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985153    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:42.986858 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985156    5068 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:42.986858 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985158    5068 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:42.986858 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985161    5068 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:42.986858 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985165    5068 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:42.986858 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985167    5068 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:42.986858 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985170    5068 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:42.986858 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985173    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:42.986858 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985176    5068 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:42.986858 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985179    5068 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:42.986858 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985182    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:42.986858 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985186    5068 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:42.986858 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985190    5068 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:42.986858 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985193    5068 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:42.987390 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985197    5068 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:42.987390 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985200    5068 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:42.987390 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985202    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:42.987390 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985205    5068 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:42.987390 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985208    5068 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:42.987390 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985211    5068 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:42.987390 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985214    5068 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:42.987390 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985216    5068 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:42.987390 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985219    5068 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:42.987390 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985222    5068 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:42.987390 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985225    5068 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:42.987390 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985227    5068 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:42.987390 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985230    5068 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:42.987390 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985233    5068 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:42.987390 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985235    5068 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:42.987390 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985238    5068 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:42.987390 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985240    5068 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:42.987390 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985243    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:42.987390 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985246    5068 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:42.987390 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985249    5068 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:42.987949 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985251    5068 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:42.987949 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985254    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:42.987949 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985256    5068 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:42.987949 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985259    5068 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:42.987949 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985261    5068 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:42.987949 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985266    5068 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:42.987949 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985271    5068 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:42.987949 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985275    5068 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:42.987949 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985278    5068 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:42.987949 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985281    5068 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:42.987949 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985284    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:42.987949 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985287    5068 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:42.987949 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985292    5068 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:42.987949 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985297    5068 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:42.987949 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985300    5068 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:42.987949 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985303    5068 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:42.987949 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985306    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:42.987949 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985308    5068 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:42.987949 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985311    5068 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:42.988438 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985314    5068 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:42.988438 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985317    5068 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:42.988438 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985319    5068 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:42.988438 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985322    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:42.988438 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985324    5068 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:42.988438 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985327    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:42.988438 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985330    5068 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:42.988438 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985332    5068 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:42.988438 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985335    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:42.988438 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985337    5068 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:42.988438 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985340    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:42.988438 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985343    5068 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:42.988438 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985346    5068 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:42.988438 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985348    5068 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:42.988438 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985351    5068 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:42.988438 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985353    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:42.988438 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985356    5068 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:42.988438 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985358    5068 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:42.988438 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985361    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:42.988438 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985364    5068 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:42.988943 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985367    5068 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:42.988943 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985369    5068 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:42.988943 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985372    5068 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:42.988943 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985375    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:42.988943 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985377    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:42.988943 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985380    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:42.988943 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985385    5068 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:42.988943 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985387    5068 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:42.988943 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985390    5068 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:42.988943 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985392    5068 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:42.988943 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985395    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:42.988943 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985397    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:42.988943 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985400    5068 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:42.988943 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985402    5068 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:42.988943 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985405    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:42.988943 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985408    5068 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:42.988943 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985410    5068 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:42.988943 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985413    5068 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:42.988943 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985415    5068 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:42.988943 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985418    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:42.989462 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985421    5068 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:42.989462 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985423    5068 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:42.989462 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985426    5068 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:42.989462 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985430    5068 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:42.989462 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985432    5068 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:42.989462 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985435    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:42.989462 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985437    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:42.989462 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985440    5068 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:42.989462 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985442    5068 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:42.989462 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985445    5068 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:42.989462 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985962    5068 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:42.989462 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985969    5068 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:42.989462 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985973    5068 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:42.989462 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985976    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:42.989462 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985978    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:42.989462 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985981    5068 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:42.989462 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985984    5068 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:42.989462 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985987    5068 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:42.989462 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985991    5068 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:42.989967 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985994    5068 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:42.989967 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985996    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:42.989967 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.985999    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:42.989967 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986002    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:42.989967 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986004    5068 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:42.989967 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986007    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:42.989967 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986009    5068 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:42.989967 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986012    5068 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:42.989967 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986015    5068 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:42.989967 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986017    5068 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:42.989967 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986020    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:42.989967 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986022    5068 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:42.989967 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986025    5068 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:42.989967 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986027    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:42.989967 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986030    5068 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:42.989967 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986033    5068 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:42.989967 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986035    5068 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:42.989967 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986038    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:42.989967 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986040    5068 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:42.990430 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986043    5068 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:42.990430 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986045    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:42.990430 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986048    5068 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:42.990430 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986050    5068 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:42.990430 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986053    5068 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:42.990430 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986056    5068 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:42.990430 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986058    5068 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:42.990430 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986061    5068 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:42.990430 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986064    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:42.990430 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986067    5068 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:42.990430 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986069    5068 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:42.990430 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986072    5068 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:42.990430 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986075    5068 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:42.990430 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986077    5068 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:42.990430 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986080    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:42.990430 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986083    5068 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:42.990430 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986087    5068 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:42.990430 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986090    5068 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:42.990430 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986093    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:42.990918 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986097    5068 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:42.990918 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986102    5068 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:42.990918 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986105    5068 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:42.990918 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986107    5068 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:42.990918 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986110    5068 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:42.990918 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986113    5068 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:42.990918 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986116    5068 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:42.990918 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986118    5068 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:42.990918 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986121    5068 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:42.990918 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986123    5068 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:42.990918 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986126    5068 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:42.990918 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986128    5068 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:42.990918 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986131    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:42.990918 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986134    5068 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:42.990918 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986136    5068 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:42.990918 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986139    5068 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:42.990918 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986141    5068 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:42.990918 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986144    5068 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:42.990918 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986146    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:42.991380 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986149    5068 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:42.991380 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986152    5068 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:42.991380 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986156    5068 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:42.991380 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986158    5068 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:42.991380 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986161    5068 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:42.991380 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986163    5068 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:42.991380 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986166    5068 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:42.991380 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986169    5068 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:42.991380 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986171    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:42.991380 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986174    5068 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:42.991380 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986177    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:42.991380 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986179    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:42.991380 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986184    5068 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:42.991380 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986187    5068 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:42.991380 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986190    5068 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:42.991380 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986192    5068 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:42.991380 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986195    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:42.991380 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986198    5068 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:42.991380 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986200    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:42.991380 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986203    5068 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:42.991877 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986206    5068 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:42.991877 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986209    5068 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:42.991877 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986211    5068 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:42.991877 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986214    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:42.991877 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986217    5068 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:42.991877 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986219    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:42.991877 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986222    5068 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:42.991877 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986225    5068 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:42.991877 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986228    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:42.991877 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986231    5068 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:42.991877 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986234    5068 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:42.991877 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986236    5068 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:42.991877 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986239    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:42.991877 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986241    5068 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:42.991877 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986244    5068 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:42.991877 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986250    5068 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:42.991877 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986253    5068 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:42.991877 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986255    5068 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:42.991877 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986258    5068 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:42.991877 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.986261    5068 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986355    5068 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986371    5068 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986385    5068 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986390    5068 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986396    5068 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986399    5068 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986404    5068 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986408    5068 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986411    5068 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986414    5068 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986418    5068 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986421    5068 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986424    5068 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986428    5068 flags.go:64] FLAG: --cgroup-root=""
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986431    5068 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986434    5068 flags.go:64] FLAG: --client-ca-file=""
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986437    5068 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986440    5068 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986448    5068 flags.go:64] FLAG: --cluster-domain=""
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986452    5068 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986457    5068 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986462    5068 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986466    5068 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 02:55:42.992345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986472    5068 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986477    5068 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986481    5068 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986486    5068 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986492    5068 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986498    5068 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986503    5068 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986508    5068 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986512    5068 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986519    5068 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986524    5068 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986529    5068 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986533    5068 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986538    5068 flags.go:64] FLAG: --enable-server="true"
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986541    5068 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986548    5068 flags.go:64] FLAG: --event-burst="100"
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986551    5068 flags.go:64] FLAG: --event-qps="50"
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986554    5068 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986557    5068 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986560    5068 flags.go:64] FLAG: --eviction-hard=""
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986564    5068 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986567    5068 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986571    5068 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986574    5068 flags.go:64] FLAG: --eviction-soft=""
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986577    5068 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 02:55:42.992933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986580    5068 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986583    5068 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986586    5068 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986591    5068 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986595    5068 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986600    5068 flags.go:64] FLAG: --feature-gates=""
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986606    5068 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986611    5068 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986616    5068 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986621    5068 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986626    5068 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986635    5068 flags.go:64] FLAG: --help="false"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986638    5068 flags.go:64] FLAG: --hostname-override="ip-10-0-139-40.ec2.internal"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986643    5068 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986646    5068 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986649    5068 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986654    5068 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986659    5068 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986664    5068 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986668    5068 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986674    5068 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986679    5068 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986703    5068 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986711    5068 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 02:55:42.993518 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986715    5068 flags.go:64] FLAG: --kube-reserved=""
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986720    5068 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986724    5068 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986728    5068 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986731    5068 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986734    5068 flags.go:64] FLAG: --lock-file=""
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986737    5068 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986740    5068 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986743    5068 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986749    5068 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986752    5068 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986755    5068 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986778    5068 flags.go:64] FLAG: --logging-format="text"
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986783    5068 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986787    5068 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986790    5068 flags.go:64] FLAG: --manifest-url=""
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986793    5068 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986798    5068 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986801    5068 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986807    5068 flags.go:64] FLAG: --max-pods="110"
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986810    5068 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986814    5068 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986818    5068 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986821    5068 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986824    5068 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 02:55:42.994160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986828    5068 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986831    5068 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986838    5068 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986842    5068 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986846    5068 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986849    5068 flags.go:64] FLAG: --pod-cidr=""
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986852    5068 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986855    5068 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986858    5068 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986861    5068 flags.go:64] FLAG: --port="10250"
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986864    5068 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986867    5068 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01cacd1ebcb333035"
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986870    5068 flags.go:64] FLAG: --qos-reserved=""
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986874    5068 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986877    5068 flags.go:64] FLAG: --register-node="true"
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986880    5068 flags.go:64] FLAG: --register-with-taints=""
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986884    5068 flags.go:64] FLAG: --registry-burst="10"
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986886    5068 flags.go:64] FLAG: --registry-qps="5"
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986889    5068 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986893    5068 flags.go:64] FLAG: --reserved-memory=""
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986897    5068 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986900    5068 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986903    5068 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986906    5068 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986909    5068 flags.go:64] FLAG: --runonce="false"
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986912    5068 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 02:55:42.994844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986916    5068 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986919    5068 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986922    5068 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986925    5068 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986930    5068 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986933    5068 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986936    5068 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986939    5068 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986942    5068 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986948    5068 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986950    5068 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986953    5068 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986957    5068 flags.go:64] FLAG: --system-cgroups=""
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986959    5068 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986965    5068 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986968    5068 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986971    5068 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986975    5068 flags.go:64] FLAG: --tls-min-version=""
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986978    5068 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986981    5068 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986984    5068 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986987    5068 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986990    5068 flags.go:64] FLAG: --v="2"
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986994    5068 flags.go:64] FLAG: --version="false"
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.986999    5068 flags.go:64] FLAG: --vmodule=""
Oct 30 02:55:42.995486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.987003    5068 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 02:55:42.996149 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.987006    5068 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 02:55:42.996149 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987135    5068 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:42.996149 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987140    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:42.996149 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987144    5068 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:42.996149 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987148    5068 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:42.996149 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987150    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:42.996149 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987155    5068 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:42.996149 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987157    5068 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:42.996149 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987160    5068 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:42.996149 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987163    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:42.996149 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987165    5068 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:42.996149 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987168    5068 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:42.996149 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987171    5068 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:42.996149 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987174    5068 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:42.996149 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987176    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:42.996149 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987181    5068 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:42.996149 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987184    5068 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:42.996149 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987186    5068 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:42.996149 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987189    5068 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:42.996779 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987191    5068 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:42.996779 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987194    5068 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:42.996779 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987197    5068 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:42.996779 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987199    5068 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:42.996779 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987203    5068 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:42.996779 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987207    5068 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:42.996779 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987211    5068 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:42.996779 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987214    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:42.996779 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987217    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:42.996779 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987220    5068 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:42.996779 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987222    5068 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:42.996779 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987225    5068 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:42.996779 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987228    5068 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:42.996779 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987230    5068 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:42.996779 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987233    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:42.996779 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987236    5068 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:42.996779 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987238    5068 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:42.996779 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987241    5068 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:42.996779 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987244    5068 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:42.997565 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987248    5068 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:42.997565 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987250    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:42.997565 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987253    5068 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:42.997565 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987256    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:42.997565 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987258    5068 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:42.997565 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987261    5068 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:42.997565 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987264    5068 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:42.997565 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987266    5068 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:42.997565 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987269    5068 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:42.997565 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987273    5068 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:42.997565 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987276    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:42.997565 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987278    5068 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:42.997565 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987281    5068 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:42.997565 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987284    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:42.997565 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987286    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:42.997565 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987289    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:42.997565 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987291    5068 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:42.997565 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987294    5068 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:42.997565 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987297    5068 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:42.997565 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987300    5068 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:42.998361 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987302    5068 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:42.998361 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987305    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:42.998361 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987308    5068 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:42.998361 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987310    5068 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:42.998361 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987313    5068 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:42.998361 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987315    5068 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:42.998361 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987318    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:42.998361 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987321    5068 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:42.998361 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987323    5068 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:42.998361 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987327    5068 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:42.998361 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987331    5068 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:42.998361 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987334    5068 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:42.998361 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987338    5068 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:42.998361 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987341    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:42.998361 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987343    5068 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:42.998361 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987346    5068 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:42.998361 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987348    5068 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:42.998361 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987351    5068 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:42.998361 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987354    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:42.998952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987357    5068 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:42.998952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987360    5068 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:42.998952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987363    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:42.998952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987366    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:42.998952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987368    5068 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:42.998952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987371    5068 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:42.998952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987374    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:42.998952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987377    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:42.998952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987379    5068 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:42.998952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987382    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:42.998952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987384    5068 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:42.998952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987387    5068 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:42.998952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987390    5068 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:42.998952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987392    5068 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:42.998952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987395    5068 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:42.998952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987398    5068 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:42.998952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987401    5068 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:42.998952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987404    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:42.998952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987407    5068 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:42.998952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987410    5068 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:42.999471 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987413    5068 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:42.999471 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987416    5068 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:42.999471 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987418    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:42.999471 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987421    5068 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:42.999471 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987423    5068 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:42.999471 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987427    5068 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:42.999471 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987430    5068 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:42.999471 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987433    5068 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:42.999471 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987435    5068 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:42.999471 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987438    5068 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:42.999471 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.987465    5068 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 02:55:42.999471 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987504    5068 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:42.999471 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987508    5068 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:42.999471 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987514    5068 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:42.999471 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987517    5068 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:42.999471 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987522    5068 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:42.999917 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987524    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:42.999917 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987527    5068 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:42.999917 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987530    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:42.999917 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987532    5068 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:42.999917 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987535    5068 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:42.999917 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987537    5068 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:42.999917 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987540    5068 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:42.999917 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987543    5068 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:42.999917 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987546    5068 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:42.999917 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987548    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:42.999917 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987551    5068 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:42.999917 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987554    5068 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:42.999917 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987556    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:42.999917 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987559    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:42.999917 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987561    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:42.999917 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987564    5068 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:42.999917 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987566    5068 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:42.999917 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987569    5068 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:42.999917 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987572    5068 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:42.999917 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987574    5068 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:43.000405 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987577    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:43.000405 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987581    5068 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:43.000405 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987583    5068 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:43.000405 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987586    5068 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:43.000405 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987589    5068 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:43.000405 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987591    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:43.000405 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987594    5068 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:43.000405 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987597    5068 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:43.000405 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987600    5068 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:43.000405 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987604    5068 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:43.000405 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987609    5068 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:43.000405 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987613    5068 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:43.000405 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987616    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:43.000405 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987619    5068 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:43.000405 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987621    5068 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:43.000405 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987624    5068 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:43.000405 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987626    5068 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:43.000405 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987629    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:43.000405 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987632    5068 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:43.000951 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987634    5068 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:43.000951 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987637    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:43.000951 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987640    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:43.000951 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987642    5068 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:43.000951 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987645    5068 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:43.000951 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987648    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:43.000951 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987650    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:43.000951 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987653    5068 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:43.000951 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987655    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:43.000951 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987659    5068 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:43.000951 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987661    5068 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:43.000951 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987664    5068 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:43.000951 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987666    5068 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:43.000951 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987669    5068 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:43.000951 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987673    5068 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:43.000951 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987676    5068 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:43.000951 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987678    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:43.000951 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987681    5068 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:43.000951 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987698    5068 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:43.000951 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987700    5068 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:43.001531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987703    5068 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:43.001531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987705    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:43.001531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987708    5068 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:43.001531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987710    5068 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:43.001531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987716    5068 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:43.001531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987719    5068 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:43.001531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987721    5068 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:43.001531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987724    5068 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:43.001531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987727    5068 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:43.001531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987729    5068 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:43.001531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987732    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:43.001531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987735    5068 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:43.001531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987738    5068 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:43.001531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987740    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:43.001531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987743    5068 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:43.001531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987746    5068 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:43.001531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987748    5068 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:43.001531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987751    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:43.001531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987753    5068 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:43.002069 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987756    5068 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:43.002069 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987759    5068 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:43.002069 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987762    5068 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:43.002069 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987764    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:43.002069 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987767    5068 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:43.002069 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987769    5068 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:43.002069 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987772    5068 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:43.002069 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987776    5068 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:43.002069 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987779    5068 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:43.002069 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987781    5068 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:43.002069 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987784    5068 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:43.002069 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987787    5068 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:43.002069 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987791    5068 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:43.002069 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987795    5068 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:43.002069 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987798    5068 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:43.002069 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987800    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:43.002069 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987803    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:43.002069 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987808    5068 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:43.002069 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987811    5068 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:43.002524 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987814    5068 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:43.002524 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987817    5068 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:43.002524 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987819    5068 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:43.002524 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.987823    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:43.002524 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.991739    5068 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 02:55:43.002524 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.991755    5068 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 02:55:43.002524 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.991773    5068 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 02:55:43.002524 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.991779    5068 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 02:55:43.002524 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991835    5068 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:43.002524 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991840    5068 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:43.002524 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991843    5068 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:43.002524 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991846    5068 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:43.002524 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991849    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:43.002524 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991852    5068 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:43.002524 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991855    5068 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:43.002524 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991859    5068 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:43.002524 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991863    5068 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:43.002524 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991868    5068 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:43.002524 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991871    5068 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:43.003201 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991874    5068 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:43.003201 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991877    5068 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:43.003201 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991881    5068 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:43.003201 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991884    5068 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:43.003201 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991888    5068 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:43.003201 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991893    5068 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:43.003201 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991896    5068 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:43.003201 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991901    5068 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:43.003201 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991904    5068 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:43.003201 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991907    5068 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:43.003201 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991910    5068 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:43.003201 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991913    5068 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:43.003201 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991915    5068 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:43.003201 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991918    5068 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:43.003201 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991921    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:43.003201 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991923    5068 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:43.003201 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991926    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:43.003201 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991929    5068 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:43.003201 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991940    5068 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:43.003201 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991943    5068 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:43.003680 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991946    5068 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:43.003680 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991948    5068 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:43.003680 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991951    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:43.003680 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991954    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:43.003680 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991956    5068 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:43.003680 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991959    5068 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:43.003680 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991961    5068 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:43.003680 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991964    5068 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:43.003680 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991966    5068 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:43.003680 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991969    5068 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:43.003680 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991972    5068 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:43.003680 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991974    5068 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:43.003680 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991977    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:43.003680 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991980    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:43.003680 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991983    5068 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:43.003680 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991985    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:43.003680 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991988    5068 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:43.003680 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991990    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:43.003680 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991993    5068 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:43.004168 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991996    5068 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:43.004168 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.991998    5068 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:43.004168 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992001    5068 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:43.004168 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992004    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:43.004168 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992006    5068 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:43.004168 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992009    5068 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:43.004168 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992012    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:43.004168 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992014    5068 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:43.004168 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992017    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:43.004168 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992019    5068 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:43.004168 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992022    5068 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:43.004168 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992024    5068 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:43.004168 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992032    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:43.004168 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992035    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:43.004168 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992038    5068 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:43.004168 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992041    5068 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:43.004168 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992043    5068 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:43.004168 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992046    5068 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:43.004168 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992048    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:43.004618 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992051    5068 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:43.004618 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992054    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:43.004618 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992056    5068 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:43.004618 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992059    5068 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:43.004618 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992061    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:43.004618 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992064    5068 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:43.004618 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992066    5068 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:43.004618 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992069    5068 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:43.004618 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992072    5068 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:43.004618 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992074    5068 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:43.004618 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992077    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:43.004618 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992080    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:43.004618 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992083    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:43.004618 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992086    5068 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:43.004618 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992088    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:43.004618 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992091    5068 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:43.004618 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992094    5068 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:43.004618 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992096    5068 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:43.004618 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992099    5068 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:43.005098 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992101    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:43.005098 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992104    5068 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:43.005098 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992107    5068 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:43.005098 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992109    5068 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:43.005098 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992112    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:43.005098 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992114    5068 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:43.005098 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992117    5068 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:43.005098 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992125    5068 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:43.005098 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992128    5068 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:43.005098 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992130    5068 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:43.005098 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992133    5068 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:43.005098 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992136    5068 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:43.005098 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992138    5068 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:43.005098 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992141    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:43.005098 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992143    5068 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:43.005098 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992146    5068 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:43.005098 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992148    5068 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:43.005098 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992151    5068 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:43.005531 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.992178    5068 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 02:55:43.005531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992355    5068 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:43.005531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992359    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:43.005531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992362    5068 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:43.005531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992365    5068 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:43.005531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992369    5068 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:43.005531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992374    5068 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:43.005531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992377    5068 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:43.005531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992380    5068 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:43.005531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992382    5068 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:43.005531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992385    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:43.005531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992388    5068 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:43.005531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992390    5068 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:43.005531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992393    5068 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:43.005531 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992395    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:43.005985 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992398    5068 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:43.005985 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992401    5068 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:43.005985 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992403    5068 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:43.005985 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992406    5068 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:43.005985 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992409    5068 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:43.005985 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992411    5068 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:43.005985 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992414    5068 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:43.005985 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992422    5068 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:43.005985 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992425    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:43.005985 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992428    5068 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:43.005985 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992430    5068 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:43.005985 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992433    5068 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:43.005985 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992435    5068 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:43.005985 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992438    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:43.005985 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992441    5068 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:43.005985 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992443    5068 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:43.005985 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992445    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:43.005985 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992448    5068 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:43.005985 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992451    5068 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:43.005985 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992453    5068 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:43.006477 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992456    5068 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:43.006477 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992458    5068 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:43.006477 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992461    5068 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:43.006477 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992464    5068 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:43.006477 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992467    5068 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:43.006477 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992469    5068 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:43.006477 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992471    5068 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:43.006477 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992474    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:43.006477 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992477    5068 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:43.006477 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992479    5068 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:43.006477 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992482    5068 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:43.006477 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992484    5068 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:43.006477 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992487    5068 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:43.006477 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992490    5068 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:43.006477 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992493    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:43.006477 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992496    5068 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:43.006477 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992498    5068 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:43.006477 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992501    5068 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:43.006477 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992503    5068 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:43.006477 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992506    5068 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:43.006986 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992514    5068 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:43.006986 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992517    5068 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:43.006986 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992519    5068 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:43.006986 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992522    5068 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:43.006986 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992524    5068 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:43.006986 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992527    5068 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:43.006986 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992529    5068 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:43.006986 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992532    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:43.006986 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992535    5068 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:43.006986 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992537    5068 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:43.006986 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992541    5068 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:43.006986 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992544    5068 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:43.006986 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992548    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:43.006986 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992551    5068 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:43.006986 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992553    5068 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:43.006986 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992557    5068 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:43.006986 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992559    5068 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:43.006986 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992562    5068 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:43.007418 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992564    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:43.007418 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992566    5068 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:43.007418 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992569    5068 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:43.007418 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992572    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:43.007418 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992581    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:43.007418 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992584    5068 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:43.007418 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992586    5068 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:43.007418 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992589    5068 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:43.007418 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992592    5068 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:43.007418 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992594    5068 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:43.007418 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992597    5068 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:43.007418 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992599    5068 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:43.007418 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992602    5068 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:43.007418 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992605    5068 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:43.007418 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992607    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:43.007418 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992615    5068 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:43.007418 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992618    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:43.007418 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992621    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:43.007418 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992623    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:43.007418 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992626    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:43.007952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992629    5068 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:43.007952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992631    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:43.007952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992634    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:43.007952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992636    5068 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:43.007952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992639    5068 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:43.007952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992641    5068 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:43.007952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992644    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:43.007952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992646    5068 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:43.007952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992649    5068 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:43.007952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992651    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:43.007952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992654    5068 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:43.007952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992660    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:43.007952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992663    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:43.007952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992666    5068 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:43.007952 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.992711    5068 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 02:55:43.007952 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992750    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:55:43.008340 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992755    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:55:43.008340 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992758    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:55:43.008340 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992761    5068 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:55:43.008340 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992765    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:55:43.008340 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992767    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:55:43.008340 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992770    5068 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:55:43.008340 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992772    5068 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:55:43.008340 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992775    5068 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:55:43.008340 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992777    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:55:43.008340 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992780    5068 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:55:43.008340 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992783    5068 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:55:43.008340 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992785    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:55:43.008340 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992794    5068 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:55:43.008340 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992796    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:55:43.008340 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992799    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:55:43.008340 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992802    5068 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:55:43.008340 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992804    5068 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:55:43.008340 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992807    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:55:43.008340 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992810    5068 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:55:43.008817 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992812    5068 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:55:43.008817 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992816    5068 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:55:43.008817 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992820    5068 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:55:43.008817 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992824    5068 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:55:43.008817 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992827    5068 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:55:43.008817 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992829    5068 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:55:43.008817 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992832    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:55:43.008817 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992834    5068 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:55:43.008817 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992837    5068 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:55:43.008817 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992841    5068 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:55:43.008817 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992844    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:55:43.008817 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992847    5068 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:55:43.008817 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992849    5068 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:55:43.008817 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992852    5068 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:55:43.008817 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992863    5068 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:55:43.008817 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992865    5068 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:55:43.008817 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992868    5068 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:55:43.008817 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992871    5068 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:55:43.008817 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992873    5068 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:55:43.009319 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992876    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:55:43.009319 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992879    5068 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:55:43.009319 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992881    5068 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:55:43.009319 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992884    5068 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:55:43.009319 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992886    5068 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:55:43.009319 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992889    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:55:43.009319 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992892    5068 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:55:43.009319 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992900    5068 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:55:43.009319 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992903    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:55:43.009319 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992906    5068 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:55:43.009319 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992911    5068 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:55:43.009319 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992914    5068 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:55:43.009319 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992916    5068 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:55:43.009319 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992919    5068 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:55:43.009319 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992922    5068 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:55:43.009319 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992924    5068 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:55:43.009319 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992927    5068 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:55:43.009319 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992929    5068 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:55:43.009319 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992932    5068 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:55:43.009319 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992935    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:55:43.009819 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992938    5068 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:55:43.009819 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992940    5068 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:55:43.009819 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992945    5068 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:55:43.009819 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992948    5068 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:55:43.009819 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992950    5068 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:55:43.009819 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992953    5068 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:55:43.009819 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992956    5068 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:55:43.009819 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992959    5068 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:55:43.009819 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992961    5068 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:55:43.009819 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992964    5068 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:55:43.009819 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992966    5068 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:55:43.009819 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992969    5068 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:55:43.009819 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992971    5068 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:55:43.009819 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992975    5068 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:55:43.009819 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992977    5068 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:55:43.009819 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992980    5068 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:55:43.009819 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992982    5068 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:55:43.009819 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992985    5068 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:55:43.009819 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992987    5068 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:55:43.009819 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992990    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:55:43.010288 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.992998    5068 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:55:43.010288 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993001    5068 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:55:43.010288 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993007    5068 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:55:43.010288 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993011    5068 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:55:43.010288 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993014    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:55:43.010288 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993017    5068 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:55:43.010288 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993019    5068 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:55:43.010288 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993022    5068 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:55:43.010288 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993025    5068 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:55:43.010288 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993028    5068 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:55:43.010288 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993030    5068 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:55:43.010288 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993033    5068 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:55:43.010288 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993035    5068 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:55:43.010288 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993038    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:55:43.010288 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993042    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:55:43.010288 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993045    5068 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:55:43.010288 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993048    5068 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:55:43.010288 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993050    5068 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:55:43.010288 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993053    5068 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:55:43.010770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993055    5068 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:55:43.010770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993058    5068 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:55:43.010770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993061    5068 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:55:43.010770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993064    5068 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:55:43.010770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993066    5068 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:55:43.010770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993069    5068 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:55:43.010770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993072    5068 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:55:43.010770 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:42.993075    5068 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:55:43.010770 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.993137    5068 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 02:55:43.010770 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.994115    5068 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 02:55:43.010770 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.994164    5068 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 02:55:43.010770 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.994360    5068 server.go:1014] "Starting client certificate rotation"
Oct 30 02:55:43.010770 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.994507    5068 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 02:55:43.010770 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.994576    5068 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 02:50:01 +0000 UTC" deadline="2028-06-03 21:14:48.94305012 +0000 UTC"
Oct 30 02:55:43.010770 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.994616    5068 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13986h19m5.948437113s"
Oct 30 02:55:43.010770 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.994889    5068 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 02:55:43.011176 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.996176    5068 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 02:55:43.011176 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:42.999106    5068 log.go:25] "Validated CRI v1 runtime API"
Oct 30 02:55:43.011176 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.000787    5068 log.go:25] "Validated CRI v1 image API"
Oct 30 02:55:43.011176 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.001574    5068 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 02:55:43.011176 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.003571    5068 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 838d8d87-71a7-4bc6-af02-65fd3f3049ba:/dev/nvme0n1p4 ea5950d7-d8c6-47d8-a672-fc662b04c21a:/dev/nvme0n1p3]
Oct 30 02:55:43.011328 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.003590    5068 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/06860450ca218963d74725411ea817c87d93c19e434bf93bffa29145d69b59c3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/06860450ca218963d74725411ea817c87d93c19e434bf93bffa29145d69b59c3/userdata/shm major:0 minor:346 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0895874fbf1fcffa737c54a0d5c9ff50fd0c69844c66983cb6a20175342fa302/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0895874fbf1fcffa737c54a0d5c9ff50fd0c69844c66983cb6a20175342fa302/userdata/shm major:0 minor:348 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/21996c845836702ed6c2c3c3db3f67ad5a8ea3ede4128a0d662f4f818c8ae444/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/21996c845836702ed6c2c3c3db3f67ad5a8ea3ede4128a0d662f4f818c8ae444/userdata/shm major:0 minor:229 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/230ac6de6e893d97e822445db3f2b1d39dc58f65c5bf1ed0d369978489c599b2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/230ac6de6e893d97e822445db3f2b1d39dc58f65c5bf1ed0d369978489c599b2/userdata/shm major:0 minor:93 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2cd490b988c362cbb893489ce14566b048da22c844d6cfbcc1fbb8c201cec6e7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2cd490b988c362cbb893489ce14566b048da22c844d6cfbcc1fbb8c201cec6e7/userdata/shm major:0 minor:296 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2d2206cb145dac70a5c592f4ba5f28d6819fd23f085595e6de3db9b205101f76/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2d2206cb145dac70a5c592f4ba5f28d6819fd23f085595e6de3db9b205101f76/userdata/shm major:0 minor:358 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2f28b1ac5fdb018e3800d9e19facff06b608e94d618b8cbf614cf4a102ac4179/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2f28b1ac5fdb018e3800d9e19facff06b608e94d618b8cbf614cf4a102ac4179/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/36e82d5fcd9df33692ef6adb14fd67afaa8a0f2166a649081984668c37cc9841/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/36e82d5fcd9df33692ef6adb14fd67afaa8a0f2166a649081984668c37cc9841/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3ab3592f705d0766da0a3e81cd5d84aceb2aecd36fdc10c0d137ff9ba0fcb1ec/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3ab3592f705d0766da0a3e81cd5d84aceb2aecd36fdc10c0d137ff9ba0fcb1ec/userdata/shm major:0 minor:302 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3bca95cdd0fe0019dcf1a867b9567196b2fa927a598208b1c7ee6d85c9f8add1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3bca95cdd0fe0019dcf1a867b9567196b2fa927a598208b1c7ee6d85c9f8add1/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/49a9b21ab3550493e45c7862e6578c96e20198340da742eee902e28646cc06e5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/49a9b21ab3550493e45c7862e6578c96e20198340da742eee902e28646cc06e5/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/54be5e07d8720fe6aa36a70fc66f11286429e336b21da6f6087d0c203d29f802/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/54be5e07d8720fe6aa36a70fc66f11286429e336b21da6f6087d0c203d29f802/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6864fedfd19107c47747bbb25dd14d8697817daf0cadb4d28bab06c419dc512c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6864fedfd19107c47747bbb25dd14d8697817daf0cadb4d28bab06c419dc512c/userdata/shm major:0 minor:234 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6cb67bd48c780dda9552e1d4ccb9e78dc8341eeaa952f1adf1a62f7a9e7e65a4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6cb67bd48c780dda9552e1d4ccb9e78dc8341eeaa952f1adf1a62f7a9e7e65a4/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7237b50f031cfcbf825d6c015d550fc8cad95978348c6526707ea3a73720c739/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7237b50f031cfcbf825d6c015d550fc8cad95978348c6526707ea3a73720c739/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7c4bc173d0fc2f93b0e01aa9dd4c04cd1100e1f9abee52930e759fc2d971ff25/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7c4bc173d0fc2f93b0e01aa9dd4c04cd1100e1f9abee52930e759fc2d971ff25/userdata/shm major:0 minor:100 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/86839444e77438014c85f53a8092c7ecbe477e631c2e6af015d7e2488be31ee4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/86839444e77438014c85f53a8092c7ecbe477e631c2e6af015d7e2488be31ee4/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/93de7f62dfb50c8fdd6431acbf6e83b5eeb451c7f6dd09d9443832a3961acf08/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/93de7f62dfb50c8fdd6431acbf6e83b5eeb451c7f6dd09d9443832a3961acf08/userdata/shm major:0 minor:315 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/98411c164c65cc49d1894155d122f6f006daa9e2326f1d52619163e0c8f00718/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/98411c164c65cc49d1894155d122f6f006daa9e2326f1d52619163e0c8f00718/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a282c6dc95965d366bf89fc39cb76170011e226f46269643466fc13519a91462/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a282c6dc95965d366bf89fc39cb76170011e226f46269643466fc13519a91462/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c75ec095347bb169c5b0a9e4c9189a081527e23173b7fca5b424138db80e58a0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c75ec095347bb169c5b0a9e4c9189a081527e23173b7fca5b424138db80e58a0/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cd0e21a5b2653ff2f9f41714d6ea22b66bc398b93436c108d038fd657a0186a6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cd0e21a5b2653ff2f9f41714d6ea22b66bc398b93436c108d038fd657a0186a6/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d1b3d2596525e49f953ae23b99aaf64f553e9f05aa5204f59e815cf2848edf68/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d1b3d2596525e49f953ae23b99aaf64f553e9f05aa5204f59e815cf2848edf68/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e69959f8fe774d281b347acd15309b101903f107b1dd251aba28df3bc02afdcd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e69959f8fe774d281b347acd15309b101903f107b1dd251aba28df3bc02afdcd/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ef5630f247014f6c0303f33a21202ff1d65f9c65095993b0b32e9e20e2ddeb17/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ef5630f247014f6c0303f33a21202ff1d65f9c65095993b0b32e9e20e2ddeb17/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fd0149dbc41f1573530592c1dbd95b45c5bb1465cd7fe1531d02f835bb4b28b3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fd0149dbc41f1573530592c1dbd95b45c5bb1465cd7fe1531d02f835bb4b28b3/userdata/shm major:0 minor:92 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/008e880d-1e3d-4290-b25f-442ee1d90975/volumes/kubernetes.io~projected/kube-api-access-znv57:{mountpoint:/var/lib/kubelet/pods/008e880d-1e3d-4290-b25f-442ee1d90975/volumes/kubernetes.io~projected/kube-api-access-znv57 major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0155b708-711a-4794-9fd5-bd88e9cae690/volumes/kubernetes.io~projected/kube-api-access-8g2pl:{mountpoint:/var/lib/kubelet/pods/0155b708-711a-4794-9fd5-bd88e9cae690/volumes/kubernetes.io~projected/kube-api-access-8g2pl major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0155b708-711a-4794-9fd5-bd88e9cae690/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/0155b708-711a-4794-9fd5-bd88e9cae690/volumes/kubernetes.io~secret/serving-cert major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/05bcf726-e398-4201-b974-52406fbdc287/volumes/kubernetes.io~projected/kube-api-access-g92lj:{mountpoint:/var/lib/kubelet/pods/05bcf726-e398-4201-b974-52406fbdc287/volumes/kubernetes.io~projected/kube-api-access-g92lj major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc/volumes/kubernetes.io~projected/kube-api-access-jb76r:{mountpoint:/var/lib/kubelet/pods/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc/volumes/kubernetes.io~projected/kube-api-access-jb76r major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/16ef1049-ff3e-486a-b565-06aa545c8592/volumes/kubernetes.io~projected/kube-api-access-w79xq:{mountpoint:/var/lib/kubelet/pods/16ef1049-ff3e-486a-b565-06aa545c8592/volumes/kubernetes.io~projected/kube-api-access-w79xq major:0 minor:355 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/16ef1049-ff3e-486a-b565-06aa545c8592/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/16ef1049-ff3e-486a-b565-06aa545c8592/volumes/kubernetes.io~secret/signing-key major:0 minor:354 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/207f380c-c390-48c7-8df5-2d828b166284/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/207f380c-c390-48c7-8df5-2d828b166284/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/207f380c-c390-48c7-8df5-2d828b166284/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/207f380c-c390-48c7-8df5-2d828b166284/volumes/kubernetes.io~empty-dir/tmp major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/207f380c-c390-48c7-8df5-2d828b166284/volumes/kubernetes.io~projected/kube-api-access-xgxnj:{mountpoint:/var/lib/kubelet/pods/207f380c-c390-48c7-8df5-2d828b166284/volumes/kubernetes.io~projected/kube-api-access-xgxnj major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/23e7ce26-ee23-41a7-a925-6fa7c29eda06/volumes/kubernetes.io~projected/kube-api-access-8nzs8:{mountpoint:/var/lib/kubelet/pods/23e7ce26-ee23-41a7-a925-6fa7c29eda06/volumes/kubernetes.io~projected/kube-api-access-8nzs8 major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/23e7ce26-ee23-41a7-a925-6fa7c29eda06/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/23e7ce26-ee23-41a7-a925-6fa7c29eda06/volumes/kubernetes.io~secret/serving-cert major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26009c26-16bc-4e82-8246-ebf75fa644e9/volumes/kubernetes.io~projected/kube-api-access-n7p4v:{mountpoint:/var/lib/kubelet/pods/26009c26-16bc-4e82-8246-ebf75fa644e9/volumes/kubernetes.io~projected/kube-api-access-n7p4v major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26009c26-16bc-4e82-8246-ebf75fa644e9/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/26009c26-16bc-4e82-8246-ebf75fa644e9/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/322fa146-852c-4aca-a334-e9ba4e23d8ad/volumes/kubernetes.io~projected/kube-api-access-m4mxx:{mountpoint:/var/lib/kubelet/pods/322fa146-852c-4aca-a334-e9ba4e23d8ad/volumes/kubernetes.io~projected/kube-api-access-m4mxx major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3bbb4629-dd25-4dae-b2a0-be0099cacaeb/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/3bbb4629-dd25-4dae-b2a0-be0099cacaeb/volumes/kubernetes.io~secret/agent-certs major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/45836983-c4ed-4083-886b-07e4c4264527/volumes/kubernetes.io~projected/kube-api-access-k98hn:{mountpoint:/var/lib/kubelet/pods/45836983-c4ed-4083-886b-07e4c4264527/volumes/kubernetes.io~projected/kube-api-access-k98hn major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/46ab1416-b4cf-4b29-b8b3-38fdf77db001/volumes/kubernetes.io~projected/kube-api-access-drz2l:{mountpoint:/var/lib/kubelet/pods/46ab1416-b4cf-4b29-b8b3-38fdf77db001/volumes/kubernetes.io~projected/kube-api-access-drz2l major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4aa93acd-52e0-4abe-ab94-12c4b3105126/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/4aa93acd-52e0-4abe-ab94-12c4b3105126/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4aa93acd-52e0-4abe-ab94-12c4b3105126/volumes/kubernetes.io~projected/kube-api-access-zs8gw:{mountpoint:/var/lib/kubelet/pods/4aa93acd-52e0-4abe-ab94-12c4b3105126/volumes/kubernetes.io~projected/kube-api-access-zs8gw major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4aa93acd-52e0-4abe-ab94-12c4b3105126/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/4aa93acd-52e0-4abe-ab94-12c4b3105126/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4f3b466e-4894-448e-bc16-a106de5cb14d/volumes/kubernetes.io~projected/kube-api-access-j9nkd:{mountpoint:/var/lib/kubelet/pods/4f3b466e-4894-448e-bc16-a106de5cb14d/volumes/kubernetes.io~projected/kube-api-access-j9nkd major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/51b2e157-f1a2-4630-aab9-9ddcd71d5bca/volumes/kubernetes.io~projected/kube-api-access-kzd97:{mountpoint:/var/lib/kubelet/pods/51b2e157-f1a2-4630-aab9-9ddcd71d5bca/volumes/kubernetes.io~projected/kube-api-access-kzd97 major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/67e06851-bb40-4be7-87dd-36b84f182f8c/volumes/kubernetes.io~projected/kube-api-access-cpfxh:{mountpoint:/var/lib/kubelet/pods/67e06851-bb40-4be7-87dd-36b84f182f8c/volumes/kubernetes.io~projected/kube-api-access-cpfxh major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6aa78c16-a2a2-4a61-adb7-575224b8ac6f/volumes/kubernetes.io~projected/kube-api-access-c4hvv:{mountpoint:/var/lib/kubelet/pods/6aa78c16-a2a2-4a61-adb7-575224b8ac6f/volumes/kubernetes.io~projected/kube-api-access-c4hvv major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7d4449be-5ad9-45a2-a708-8935ea16fed1/volumes/kubernetes.io~projected/kube-api-access-pnvfv:{mountpoint:/var/lib/kubelet/pods/7d4449be-5ad9-45a2-a708-8935ea16fed1/volumes/kubernetes.io~projected/kube-api-access-pnvfv major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7eb43cf3-056c-4372-94b6-dc57ed47dd83/volumes/kubernetes.io~projected/kube-api-access-7sq96:{mountpoint:/var/lib/kubelet/pods/7eb43cf3-056c-4372-94b6-dc57ed47dd83/volumes/kubernetes.io~projected/kube-api-access-7sq96 major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/80f1930a-aa7c-46a0-9a4c-95f35539bf4c/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/80f1930a-aa7c-46a0-9a4c-95f35539bf4c/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/80f1930a-aa7c-46a0-9a4c-95f35539bf4c/volumes/kubernetes.io~projected/kube-api-access-t8c9g:{mountpoint:/var/lib/kubelet/pods/80f1930a-aa7c-46a0-9a4c-95f35539bf4c/volumes/kubernetes.io~projected/kube-api-access-t8c9g major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/80f1930a-aa7c-46a0-9a4c-95f35539bf4c/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/80f1930a-aa7c-46a0-9a4c-95f35539bf4c/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/80f1930a-aa7c-46a0-9a4c-95f35539bf4c/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/80f1930a-aa7c-46a0-9a4c-95f35539bf4c/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d/volumes/kubernetes.io~projected/kube-api-access-br65p:{mountpoint:/var/lib/kubelet/pods/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d/volumes/kubernetes.io~projected/kube-api-access-br65p major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a707ea73-de7e-406f-89ec-9197a6c0f2b5/volumes/kubernetes.io~projected/kube-api-access-xk75k:{mountpoint:/var/lib/kubelet/pods/a707ea73-de7e-406f-89ec-9197a6c0f2b5/volumes/kubernetes.io~projected/kube-api-access-xk75k major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b1eeaa36-b8dc-4f8a-81f4-54b22848135d/volumes/kubernetes.io~projected/kube-api-access-mlm47:{mountpoint:/var/lib/kubelet/pods/b1eeaa36-b8dc-4f8a-81f4-54b22848135d/volumes/kubernetes.io~projected/kube-api-access-mlm47 major:0 minor:312 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ba0ccc16-d085-4d7f-8df5-e9194ba06f33/volumes/kubernetes.io~projected/kube-api-access-dhjmb:{mountpoint:/var/lib/kubelet/pods/ba0ccc16-d085-4d7f-8df5-e9194ba06f33/volumes/kubernetes.io~projected/kube-api-access-dhjmb major:0 minor:340 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887/volumes/kubernetes.io~projected/kube-api-access-q2pmx:{mountpoint:/var/lib/kubelet/pods/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887/volumes/kubernetes.io~projected/kube-api-access-q2pmx major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0/volumes/kubernetes.io~projected/kube-api-access-ncgfc:{mountpoint:/var/lib/kubelet/pods/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0/volumes/kubernetes.io~projected/kube-api-access-ncgfc major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0/volumes/kubernetes.io~secret/serving-cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/deae1b40-455b-40fd-af9a-c9dfa727a018/volumes/kubernetes.io~projected/kube-api-access-t9qsl:{mountpoint:/var/lib/kubelet/pods/deae1b40-455b-40fd-af9a-c9dfa727a018/volumes/kubernetes.io~projected/kube-api-access-t9qsl major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/deae1b40-455b-40fd-af9a-c9dfa727a018/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/deae1b40-455b-40fd-af9a-c9dfa727a018/volumes/kubernetes.io~secret/default-certificate major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/deae1b40-455b-40fd-af9a-c9dfa727a018/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/deae1b40-455b-40fd-af9a-c9dfa727a018/volumes/kubernetes.io~secret/stats-auth major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2/volumes/kubernetes.io~projected/kube-api-access-9frht:{mountpoint:/var/lib/kubelet/pods/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2/volumes/kubernetes.io~projected/kube-api-access-9frht major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e7a138e6-2485-4134-9d3a-c2419d154f30/volumes/kubernetes.io~projected/kube-api-access-wmgxl:{mountpoint:/var/lib/kubelet/pods/e7a138e6-2485-4134-9d3a-c2419d154f30/volumes/kubernetes.io~projected/kube-api-access-wmgxl major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ed3e2e45-04fe-4fe8-8e88-39439772c950/volumes/kubernetes.io~projected/kube-api-access-lbqgb:{mountpoint:/var/lib/kubelet/pods/ed3e2e45-04fe-4fe8-8e88-39439772c950/volumes/kubernetes.io~projected/kube-api-access-lbqgb major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ed3e2e45-04fe-4fe8-8e88-39439772c950/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/ed3e2e45-04fe-4fe8-8e88-39439772c950/volumes/kubernetes.io~secret/serving-cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ed43211b-ec42-4683-99a6-541bf0a09c7e/volumes/kubernetes.io~projected/kube-api-access-ww2rj:{mountpoint:/var/lib/kubelet/pods/ed43211b-ec42-4683-99a6-541bf0a09c7e/volumes/kubernetes.io~projected/kube-api-access-ww2rj major:0 minor:345 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f71c9dd2-5916-4cd5-9aea-6fd70a343419/volumes/kubernetes.io~projected/kube-api-access-94wx2:{mountpoint:/var/lib/kubelet/pods/f71c9dd2-5916-4cd5-9aea-6fd70a343419/volumes/kubernetes.io~projected/kube-api-access-94wx2 major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:288 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/40b763b7d5f17bae7bc8349b52b71a05a9dbd8d8e9b70442267c2170bf133453/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/e573f42dfe28ec2c2c1f6cba9cfe89e822d32064f1f1e90fe7d8e403aa6536c9/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/9c83de457e7e0e244cb4b99cdb334fabbe02f6648d7e80ae3ab798d4042c9030/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/9491e8854763c54c8ed51ddff1da12ff6a63f1eae748a39d681a8dc3ad9d7914/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/98b12a4f7c619516626ac3f3f1842519411eb902b5d79fb037be4824a4b19747/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/0b2c14c6ab78b6a9eda4f3edc40261acaf1a7db04c82fea5ceb7c37cb45b633d/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/35077942acd45e6a8b8479e6358d29c6e4b617e3a35bdf024121c484a7f366d5/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/6f13b7f71d182210032c08d2a547f1c121f131711934005ce0d75bb39ae45e73/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-133:{mountpoint:/var/lib/containers/storage/overlay/a2fccb9f6d735303851f52ef92ff2761ea165ee408e01b15850de0f4fd3290ed/merged major:0 minor:133 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/78b66660e9d0f6204a50e8f7266674e1df338bf2053b251f5e96bb1a1daa3bdb/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-143:{mountpoint:/var/lib/containers/storage/overlay/e08336b616736b40f5c8b67fea4102b8911d4d3e446e4474c9942266ae7e5ca4/merged major:0 minor:143 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/3ed3f328602e8108f256aa6c513f933fd459dde7f85d0b2b2b2acd9816fb0de8/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/496fdb4f3cbfe3011418cf4cb98e54fa71270e7387eed9ef8ab4531d4d73ddca/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/066c8dce88fec2d623feec98c2e9e58641677471fd35f097fdf270d3a06fa8f0/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/f1c75ac3331cb770bcfe4ee2cfbc1e54e0e32beb7f72bbf3ec568f0bdeb14ea9/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/d5aca39f6356297e6a4e6e7bd8ef35af49f578a3594f84d397578a56e2752e98/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/6ffe7f36bdc286c1cd457dc51bc1e6d1fc3d34fa1c266ed4c2c64858b421aa5f/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/2b7b975b8bffeaefb5ae5eff8ec71c94c601cac9275b8ab1c1e5f475c73dc239/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-184:{mountpoint:/var/lib/containers/storage/overlay/a545c95b7c5acc00bd26b92ae0a5063e1538a1772b7c395f40a004c3e565ad9e/merged major:0 minor:184 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/c3b64a041544d2d4cb395b2764e065fd99eeb06867fec41b68022eb7f40fdab1/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/3894a7f31b41b615f9c8a9b612788c1d9c5daec3d0bf4d83c7c42d462b9e5ba4/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/7f9fe38aa7f511a0d991496e3dc1abe2010c4b784396a0b9c450f22a10ddde13/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/a5337f04b4ecbae5edcf13de476edfe0c8511b1212f57bbdc9873d88eb539563/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/0e3730151948fdd3e8cbf8b75405ef7164f685fcfa646563841f411804c03726/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/a34b68cec559771af81707c55e71027e0f38dd42081b560404a599a0cfa453c5/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/6dffef58f48fc5cc08575b9f5b448234af19f751eebd28aa59b1b26a348ca63c/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/d889a2ee3c32ad64bfafd7465deac47bd13bb638aed190000b8c62a4ef5baa4c/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/24288cfb6c943501754f163f5782fc3812eb5a3142e1f075b6ca545faf06e0bc/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/05b571f90263a92156c2beedbfddcfce893a26f28e4e6b3a8dc0820badda463d/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-265:{mountpoint:/var/lib/containers/storage/overlay/e844a7d2b3641e473ff2867ae28d2690a508ea83e6047730d67e9377f6cb30d8/merged major:0 minor:265 fsType:overlay blockSize:0} overlay_0-267:{mountpoint:/var/lib/containers/storage/overlay/72df8f591510e0a6056824c1c9c9b43546777d61b2b6ccbcd37834296eaac0bc/merged major:0 minor:267 fsType:overlay blockSize:0} overlay_0-281:{mountpoint:/var/lib/containers/storage/overlay/c15e2a44a8843bf9ab4e88fd6c7b9a85cb6ace7fc1eb54d0a6fc684472656ecc/merged major:0 minor:281 fsType:overlay blockSize:0} overlay_0-283:{mountpoint:/var/lib/containers/storage/overlay/ec06135d3a3f42d9c139ee6173c5dd3f495f8e70b8c6ab63453ad057d51d1624/merged major:0 minor:283 fsType:overlay blockSize:0} overlay_0-286:{mountpoint:/var/lib/containers/storage/overlay/a766f51278736f34ca2e5e911ed5e04c03ae549de93553cfed5246406895537c/merged major:0 minor:286 fsType:overlay blockSize:0} overlay_0-294:{mountpoint:/var/lib/containers/storage/overlay/078240ab1a7463e6d6c943f9e09cf5f71f865d50579ebcc221c1725e839f4cd6/merged major:0 minor:294 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/79828162dfd5d98c9b4604aac521426d350302ead23c03936b0f90a759a8f6b5/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-306:{mountpoint:/var/lib/containers/storage/overlay/7eb9e99add360467d27c7e5d6f5546609a24f1c618e4abf8a9791ec1feda52bf/merged major:0 minor:306 fsType:overlay blockSize:0} overlay_0-308:{mountpoint:/var/lib/containers/storage/overlay/a6fd9c33498db8fe3ad12cf20a616e9dfbf7c5b8f82afe3f0cae7b17d3ed177f/merged major:0 minor:308 fsType:overlay blockSize:0} overlay_0-310:{mountpoint:/var/lib/containers/storage/overlay/96754f4183580a29c875b047bfb659dfd8cb49cfeefccb96e7713607efa5fba4/merged major:0 minor:310 fsType:overlay blockSize:0} overlay_0-313:{mountpoint:/var/lib/containers/storage/overlay/0f790f819cc0a13de045ea4e057fd1b18ed435cfd9fb6cbfcad9273650008f4c/merged major:0 minor:313 fsType:overlay blockSize:0} overlay_0-317:{mountpoint:/var/lib/containers/storage/overlay/9e2d6071d1a68987fee9b5604470cb0201685a5484cd108b8edb6c26f15a7f8f/merged major:0 minor:317 fsType:overlay blockSize:0} overlay_0-331:{mountpoint:/var/lib/containers/storage/overlay/76cf8e71073673250932bb55185b7fb82e61eb9552df00ef448a693ec444b994/merged major:0 minor:331 fsType:overlay blockSize:0} overlay_0-338:{mountpoint:/var/lib/containers/storage/overlay/ff43c21c86127260c86d479c2a584478767efea92820016787793c0e54d22ccb/merged major:0 minor:338 fsType:overlay blockSize:0} overlay_0-350:{mountpoint:/var/lib/containers/storage/overlay/af55b1aafa4773b96417f3c7d5451b9221d5f41cea324c5e5a935f0437c33bff/merged major:0 minor:350 fsType:overlay blockSize:0} overlay_0-352:{mountpoint:/var/lib/containers/storage/overlay/36962ced74a8741e40291110379847de7273dc4da8b08ca62e9177e0e7f6b73e/merged major:0 minor:352 fsType:overlay blockSize:0} overlay_0-356:{mountpoint:/var/lib/containers/storage/overlay/ef077bc7e796a79a58c5b392b5469618d202f29aa76767293a0c5f7bdf550de8/merged major:0 minor:356 fsType:overlay blockSize:0} overlay_0-364:{mountpoint:/var/lib/containers/storage/overlay/5402e7ab49e5411cc2b7e7ca3e25ba5679f4feb726f2cfe5344f960f0b7b57e3/merged major:0 minor:364 fsType:overlay blockSize:0} overlay_0-366:{mountpoint:/var/lib/containers/storage/overlay/f3c614bfd9beeb3847d9d74e5fa37502f08fcc11cff8e86feaffdf56bcbdbb3c/merged major:0 minor:366 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/5fefbbd40c029ab8e237a9953199fea8c7f0a6a55d3ce976d2b7f5124a286777/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/f6b769ac4e27325aa97f4ac01bd430834e4569f471a7e407a85ebb5dce535ef4/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-376:{mountpoint:/var/lib/containers/storage/overlay/65ef1fdbac222eae305422970717ceb39e06446074a3e9f3604693bdc4c2177a/merged major:0 minor:376 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/8c430e7960d8bb1b79cd357a01fccdaf54e3a91f20df33cc51b2111f471418f2/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/9989b674ce0e7513905340c88eeafb997d4f53cb8c1a95255562d6b48afd9b9d/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/96c0c9aedd30541fdf04e1771be850771a3527ef5cf5a9b64ada46457a3f9dfd/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/3637584663c33e56ed4d0f46e69c2e67f8cf48db5c4301761655da5a6eaf95d0/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/7bf538467e0a72fa4f44e4dd43ce9804fad5c5c6968eacb52a03a5aaeb6f3d1c/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/b0f6dbdc3c4beb6073d6fb945b7de47b0d26218bb867ad2649326c54703e21c4/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/a8cbf0ca2eea08b2af1cee2762a9e1d550be29f3b0a751068a05d9172562f781/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/89e16c5fd130a3bf32f4c6668111dd36c2a7f0d5e3d626da339bfb674bf5afa1/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/60178b602942bf22371569bf4a980dc3fad288c0baf88c75417694bdf879efcb/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/4546d6603bf33aad3b2281b07037d96902722d55ea22844dd862b07904304b8a/merged major:0 minor:96 fsType:overlay blockSize:0} overlay_0-98:{mountpoint:/var/lib/containers/storage/overlay/bf273283c6797060862987bb7e8487a00e1e668e59c9e8a694411e027e38853f/merged major:0 minor:98 fsType:overlay blockSize:0}]
Oct 30 02:55:43.012596 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.012248    5068 manager.go:217] Machine: {Timestamp:2026-10-30 02:55:43.011747646 +0000 UTC m=+0.087117849 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099468 MemoryCapacity:33164328960 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b45d7edd49f66be2ac07ca26d3c5f SystemUUID:ec2b45d7-edd4-9f66-be2a-c07ca26d3c5f BootID:34cff740-0b33-4c27-8380-88d23d53f8f0 Filesystems:[{Device:/var/lib/kubelet/pods/16ef1049-ff3e-486a-b565-06aa545c8592/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:354 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7c4bc173d0fc2f93b0e01aa9dd4c04cd1100e1f9abee52930e759fc2d971ff25/userdata/shm DeviceMajor:0 DeviceMinor:100 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-313 DeviceMajor:0 DeviceMinor:313 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-306 DeviceMajor:0 DeviceMinor:306 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fd0149dbc41f1573530592c1dbd95b45c5bb1465cd7fe1531d02f835bb4b28b3/userdata/shm DeviceMajor:0 DeviceMinor:92 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/deae1b40-455b-40fd-af9a-c9dfa727a018/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:204 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/26009c26-16bc-4e82-8246-ebf75fa644e9/volumes/kubernetes.io~projected/kube-api-access-n7p4v DeviceMajor:0 DeviceMinor:217 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ef5630f247014f6c0303f33a21202ff1d65f9c65095993b0b32e9e20e2ddeb17/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/36e82d5fcd9df33692ef6adb14fd67afaa8a0f2166a649081984668c37cc9841/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:209 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-281 DeviceMajor:0 DeviceMinor:281 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc/volumes/kubernetes.io~projected/kube-api-access-jb76r DeviceMajor:0 DeviceMinor:333 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887/volumes/kubernetes.io~projected/kube-api-access-q2pmx DeviceMajor:0 DeviceMinor:66 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/49a9b21ab3550493e45c7862e6578c96e20198340da742eee902e28646cc06e5/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-366 DeviceMajor:0 DeviceMinor:366 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/05bcf726-e398-4201-b974-52406fbdc287/volumes/kubernetes.io~projected/kube-api-access-g92lj DeviceMajor:0 DeviceMinor:211 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/322fa146-852c-4aca-a334-e9ba4e23d8ad/volumes/kubernetes.io~projected/kube-api-access-m4mxx DeviceMajor:0 DeviceMinor:62 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/23e7ce26-ee23-41a7-a925-6fa7c29eda06/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:202 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:203 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/7eb43cf3-056c-4372-94b6-dc57ed47dd83/volumes/kubernetes.io~projected/kube-api-access-7sq96 DeviceMajor:0 DeviceMinor:223 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-352 DeviceMajor:0 DeviceMinor:352 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a282c6dc95965d366bf89fc39cb76170011e226f46269643466fc13519a91462/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/26009c26-16bc-4e82-8246-ebf75fa644e9/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0155b708-711a-4794-9fd5-bd88e9cae690/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:207 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/008e880d-1e3d-4290-b25f-442ee1d90975/volumes/kubernetes.io~projected/kube-api-access-znv57 DeviceMajor:0 DeviceMinor:222 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-310 DeviceMajor:0 DeviceMinor:310 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6864fedfd19107c47747bbb25dd14d8697817daf0cadb4d28bab06c419dc512c/userdata/shm DeviceMajor:0 DeviceMinor:234 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cd0e21a5b2653ff2f9f41714d6ea22b66bc398b93436c108d038fd657a0186a6/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/b1eeaa36-b8dc-4f8a-81f4-54b22848135d/volumes/kubernetes.io~projected/kube-api-access-mlm47 DeviceMajor:0 DeviceMinor:312 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-338 DeviceMajor:0 DeviceMinor:338 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2/volumes/kubernetes.io~projected/kube-api-access-9frht DeviceMajor:0 DeviceMinor:67 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-98 DeviceMajor:0 DeviceMinor:98 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582164480 Type:vfs Inodes:1048576 HasInodes:true} {Device:/run/containers/storage/overlay-containers/54be5e07d8720fe6aa36a70fc66f11286429e336b21da6f6087d0c203d29f802/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/deae1b40-455b-40fd-af9a-c9dfa727a018/volumes/kubernetes.io~projected/kube-api-access-t9qsl DeviceMajor:0 DeviceMinor:213 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-283 DeviceMajor:0 DeviceMinor:283 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-376 DeviceMajor:0 DeviceMinor:376 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/80f1930a-aa7c-46a0-9a4c-95f35539bf4c/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:205 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0155b708-711a-4794-9fd5-bd88e9cae690/volumes/kubernetes.io~projected/kube-api-access-8g2pl DeviceMajor:0 DeviceMinor:215 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/f71c9dd2-5916-4cd5-9aea-6fd70a343419/volumes/kubernetes.io~projected/kube-api-access-94wx2 DeviceMajor:0 DeviceMinor:225 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/46ab1416-b4cf-4b29-b8b3-38fdf77db001/volumes/kubernetes.io~projected/kube-api-access-drz2l DeviceMajor:0 DeviceMinor:293 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/207f380c-c390-48c7-8df5-2d828b166284/volumes/kubernetes.io~projected/kube-api-access-xgxnj DeviceMajor:0 DeviceMinor:60 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/4aa93acd-52e0-4abe-ab94-12c4b3105126/volumes/kubernetes.io~projected/kube-api-access-zs8gw DeviceMajor:0 DeviceMinor:64 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7237b50f031cfcbf825d6c015d550fc8cad95978348c6526707ea3a73720c739/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2cd490b988c362cbb893489ce14566b048da22c844d6cfbcc1fbb8c201cec6e7/userdata/shm DeviceMajor:0 DeviceMinor:296 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0895874fbf1fcffa737c54a0d5c9ff50fd0c69844c66983cb6a20175342fa302/userdata/shm DeviceMajor:0 DeviceMinor:348 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/21996c845836702ed6c2c3c3db3f67ad5a8ea3ede4128a0d662f4f818c8ae444/userdata/shm DeviceMajor:0 DeviceMinor:229 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6cb67bd48c780dda9552e1d4ccb9e78dc8341eeaa952f1adf1a62f7a9e7e65a4/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d1b3d2596525e49f953ae23b99aaf64f553e9f05aa5204f59e815cf2848edf68/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/06860450ca218963d74725411ea817c87d93c19e434bf93bffa29145d69b59c3/userdata/shm DeviceMajor:0 DeviceMinor:346 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e7a138e6-2485-4134-9d3a-c2419d154f30/volumes/kubernetes.io~projected/kube-api-access-wmgxl DeviceMajor:0 DeviceMinor:65 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/80f1930a-aa7c-46a0-9a4c-95f35539bf4c/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:226 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3bca95cdd0fe0019dcf1a867b9567196b2fa927a598208b1c7ee6d85c9f8add1/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2f28b1ac5fdb018e3800d9e19facff06b608e94d618b8cbf614cf4a102ac4179/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/80f1930a-aa7c-46a0-9a4c-95f35539bf4c/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:206 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-294 DeviceMajor:0 DeviceMinor:294 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-350 DeviceMajor:0 DeviceMinor:350 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3bbb4629-dd25-4dae-b2a0-be0099cacaeb/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:57 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/7d4449be-5ad9-45a2-a708-8935ea16fed1/volumes/kubernetes.io~projected/kube-api-access-pnvfv DeviceMajor:0 DeviceMinor:61 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:288 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:197 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-265 DeviceMajor:0 DeviceMinor:265 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-356 DeviceMajor:0 DeviceMinor:356 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/207f380c-c390-48c7-8df5-2d828b166284/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:58 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/a707ea73-de7e-406f-89ec-9197a6c0f2b5/volumes/kubernetes.io~projected/kube-api-access-xk75k DeviceMajor:0 DeviceMinor:63 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-317 DeviceMajor:0 DeviceMinor:317 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6aa78c16-a2a2-4a61-adb7-575224b8ac6f/volumes/kubernetes.io~projected/kube-api-access-c4hvv DeviceMajor:0 DeviceMinor:218 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/80f1930a-aa7c-46a0-9a4c-95f35539bf4c/volumes/kubernetes.io~projected/kube-api-access-t8c9g DeviceMajor:0 DeviceMinor:219 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/51b2e157-f1a2-4630-aab9-9ddcd71d5bca/volumes/kubernetes.io~projected/kube-api-access-kzd97 DeviceMajor:0 DeviceMinor:224 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-286 DeviceMajor:0 DeviceMinor:286 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3ab3592f705d0766da0a3e81cd5d84aceb2aecd36fdc10c0d137ff9ba0fcb1ec/userdata/shm DeviceMajor:0 DeviceMinor:302 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d/volumes/kubernetes.io~projected/kube-api-access-br65p DeviceMajor:0 DeviceMinor:221 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/93de7f62dfb50c8fdd6431acbf6e83b5eeb451c7f6dd09d9443832a3961acf08/userdata/shm DeviceMajor:0 DeviceMinor:315 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/16ef1049-ff3e-486a-b565-06aa545c8592/volumes/kubernetes.io~projected/kube-api-access-w79xq DeviceMajor:0 DeviceMinor:355 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-133 DeviceMajor:0 DeviceMinor:133 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c75ec095347bb169c5b0a9e4c9189a081527e23173b7fca5b424138db80e58a0/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ed3e2e45-04fe-4fe8-8e88-39439772c950/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:201 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-267 DeviceMajor:0 DeviceMinor:267 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-308 DeviceMajor:0 DeviceMinor:308 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-331 DeviceMajor:0 DeviceMinor:331 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/86839444e77438014c85f53a8092c7ecbe477e631c2e6af015d7e2488be31ee4/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/4aa93acd-52e0-4abe-ab94-12c4b3105126/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:55 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ed3e2e45-04fe-4fe8-8e88-39439772c950/volumes/kubernetes.io~projected/kube-api-access-lbqgb DeviceMajor:0 DeviceMinor:210 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/23e7ce26-ee23-41a7-a925-6fa7c29eda06/volumes/kubernetes.io~projected/kube-api-access-8nzs8 DeviceMajor:0 DeviceMinor:216 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-364 DeviceMajor:0 DeviceMinor:364 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:212 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0/volumes/kubernetes.io~projected/kube-api-access-ncgfc DeviceMajor:0 DeviceMinor:220 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/207f380c-c390-48c7-8df5-2d828b166284/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:56 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/deae1b40-455b-40fd-af9a-c9dfa727a018/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:208 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2d2206cb145dac70a5c592f4ba5f28d6819fd23f085595e6de3db9b205101f76/userdata/shm DeviceMajor:0 DeviceMinor:358 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/67e06851-bb40-4be7-87dd-36b84f182f8c/volumes/kubernetes.io~projected/kube-api-access-cpfxh DeviceMajor:0 DeviceMinor:59 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e69959f8fe774d281b347acd15309b101903f107b1dd251aba28df3bc02afdcd/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/98411c164c65cc49d1894155d122f6f006daa9e2326f1d52619163e0c8f00718/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/230ac6de6e893d97e822445db3f2b1d39dc58f65c5bf1ed0d369978489c599b2/userdata/shm DeviceMajor:0 DeviceMinor:93 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-143 DeviceMajor:0 DeviceMinor:143 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-184 DeviceMajor:0 DeviceMinor:184 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4aa93acd-52e0-4abe-ab94-12c4b3105126/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/4f3b466e-4894-448e-bc16-a106de5cb14d/volumes/kubernetes.io~projected/kube-api-access-j9nkd DeviceMajor:0 DeviceMinor:214 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/45836983-c4ed-4083-886b-07e4c4264527/volumes/kubernetes.io~projected/kube-api-access-k98hn DeviceMajor:0 DeviceMinor:227 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ba0ccc16-d085-4d7f-8df5-e9194ba06f33/volumes/kubernetes.io~projected/kube-api-access-dhjmb DeviceMajor:0 DeviceMinor:340 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/ed43211b-ec42-4683-99a6-541bf0a09c7e/volumes/kubernetes.io~projected/kube-api-access-ww2rj DeviceMajor:0 DeviceMinor:345 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:06860450ca21896 MacAddress:36:d9:df:66:fd:b8 Speed:10000 Mtu:8901} {Name:0895874fbf1fcff MacAddress:16:e1:61:33:87:e6 Speed:10000 Mtu:8901} {Name:21996c845836702 MacAddress:d2:e5:77:98:c2:e7 Speed:10000 Mtu:8901} {Name:2cd490b988c362c MacAddress:b2:21:5c:8a:51:90 Speed:10000 Mtu:8901} {Name:2d2206cb145dac7 MacAddress:96:38:3d:b6:26:b9 Speed:10000 Mtu:8901} {Name:36e82d5fcd9df33 MacAddress:3e:49:a0:22:f0:f5 Speed:10000 Mtu:8901} {Name:3ab3592f705d076 MacAddress:76:78:f9:85:46:c2 Speed:10000 Mtu:8901} {Name:3bca95cdd0fe001 MacAddress:f2:f0:3f:c6:61:cf Speed:10000 Mtu:8901} {Name:6864fedfd19107c MacAddress:ae:9d:4d:ce:88:ce Speed:10000 Mtu:8901} {Name:6cb67bd48c780dd MacAddress:e2:d3:75:45:7b:5a Speed:10000 Mtu:8901} {Name:7237b50f031cfcb MacAddress:c2:85:7d:d6:83:02 Speed:10000 Mtu:8901} {Name:93de7f62dfb50c8 MacAddress:4a:a6:43:49:c1:7c Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:c8:4b:26:83 Speed:0 Mtu:9001} {Name:br-int MacAddress:be:6c:19:fb:ba:58 Speed:0 Mtu:8901} {Name:c75ec095347bb16 MacAddress:ee:bb:66:db:e2:d7 Speed:10000 Mtu:8901} {Name:cd0e21a5b2653ff MacAddress:8e:fe:93:3b:0f:fa Speed:10000 Mtu:8901} {Name:d1b3d2596525e49 MacAddress:ee:63:fd:41:81:1e Speed:10000 Mtu:8901} {Name:ef5630f247014f6 MacAddress:06:a9:6e:3f:eb:8f Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:c8:4b:26:83 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:fa:bb:7b:de:3f:c5 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:3e:10:10:d4:ac:bf Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164328960 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 02:55:43.012821 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.012600    5068 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 02:55:43.012821 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.012642    5068 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 02:55:43.013023 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.013002    5068 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 02:55:43.013146 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.013024    5068 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-40.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 02:55:43.013189 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.013148    5068 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 02:55:43.013189 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.013156    5068 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 02:55:43.013189 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.013169    5068 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 02:55:43.013189 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.013188    5068 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 02:55:43.013286 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.013208    5068 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 02:55:43.013374 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.013364    5068 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 02:55:43.013478 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.013470    5068 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 02:55:43.013513 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.013505    5068 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 02:55:43.013542 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.013517    5068 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 02:55:43.013542 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.013526    5068 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 02:55:43.013542 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.013534    5068 kubelet.go:405] "Adding apiserver pod source"
Oct 30 02:55:43.013542 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.013542    5068 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 02:55:43.015906 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.015287    5068 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 02:55:43.015906 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.015309    5068 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 02:55:43.016257 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.016229    5068 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 02:55:43.018696 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.018673    5068 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 02:55:43.018765 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.018700    5068 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 02:55:43.018805 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.018792    5068 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 02:55:43.018995 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.018983    5068 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 02:55:43.019039 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.019013    5068 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 02:55:43.019117 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.019108    5068 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 02:55:43.019156 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.019123    5068 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 02:55:43.019156 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.019129    5068 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 02:55:43.019156 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.019134    5068 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 02:55:43.019156 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.019139    5068 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 02:55:43.019156 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.019145    5068 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 02:55:43.019156 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.019152    5068 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 02:55:43.019156 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.019157    5068 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 02:55:43.019365 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.019163    5068 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 02:55:43.019365 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.019169    5068 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 02:55:43.019365 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.019182    5068 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 02:55:43.019365 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.019191    5068 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 02:55:43.019365 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.019217    5068 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 02:55:43.019365 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.019223    5068 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 02:55:43.022609 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.022591    5068 server.go:1263] "Started kubelet"
Oct 30 02:55:43.022812 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.022785    5068 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 02:55:43.023024 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.022931    5068 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 02:55:43.023024 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.022996    5068 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 02:55:43.023105 ip-10-0-139-40 systemd[1]: Started Kubernetes Kubelet.
Oct 30 02:55:43.023867 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.023282    5068 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 02:55:43.024402 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.024143    5068 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 02:55:43.026648 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.026629    5068 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 02:55:43.026777 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.026758    5068 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 02:55:43.026849 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.026812    5068 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 02:50:03 +0000 UTC" deadline="2028-07-15 23:44:41.62325418 +0000 UTC"
Oct 30 02:55:43.026908 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.026851    5068 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14996h48m58.596406205s"
Oct 30 02:55:43.026908 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:43.026879    5068 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-40.ec2.internal\" not found"
Oct 30 02:55:43.026994 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.026911    5068 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 02:55:43.026994 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.026923    5068 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 02:55:43.027125 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.027111    5068 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 02:55:43.033402 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.031556    5068 factory.go:55] Registering systemd factory
Oct 30 02:55:43.033402 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.031577    5068 factory.go:223] Registration of the systemd container factory successfully
Oct 30 02:55:43.033402 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.031932    5068 factory.go:153] Registering CRI-O factory
Oct 30 02:55:43.033402 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.031949    5068 factory.go:223] Registration of the crio container factory successfully
Oct 30 02:55:43.033402 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.032002    5068 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 02:55:43.033402 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.032017    5068 factory.go:103] Registering Raw factory
Oct 30 02:55:43.034811 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.033846    5068 manager.go:1199] Started watching for new ooms in manager
Oct 30 02:55:43.034811 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.034230    5068 manager.go:319] Starting recovery of all containers
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035527    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="deae1b40-455b-40fd-af9a-c9dfa727a018" volumeName="kubernetes.io/projected/deae1b40-455b-40fd-af9a-c9dfa727a018-kube-api-access-t9qsl" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035586    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0155b708-711a-4794-9fd5-bd88e9cae690" volumeName="kubernetes.io/secret/0155b708-711a-4794-9fd5-bd88e9cae690-serving-cert" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035601    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4aa93acd-52e0-4abe-ab94-12c4b3105126" volumeName="kubernetes.io/configmap/4aa93acd-52e0-4abe-ab94-12c4b3105126-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035615    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="67e06851-bb40-4be7-87dd-36b84f182f8c" volumeName="kubernetes.io/projected/67e06851-bb40-4be7-87dd-36b84f182f8c-kube-api-access-cpfxh" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035634    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="80f1930a-aa7c-46a0-9a4c-95f35539bf4c" volumeName="kubernetes.io/secret/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035648    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" volumeName="kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-bound-sa-token" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035667    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dec5346e-cd73-40b5-bcf4-05bc1a7e33e2" volumeName="kubernetes.io/configmap/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2-serviceca" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035680    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dec5346e-cd73-40b5-bcf4-05bc1a7e33e2" volumeName="kubernetes.io/projected/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2-kube-api-access-9frht" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035712    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="744bf9e1-3e8b-402c-863a-331a6786f85c" volumeName="kubernetes.io/configmap/744bf9e1-3e8b-402c-863a-331a6786f85c-nginx-conf" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035730    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7eb43cf3-056c-4372-94b6-dc57ed47dd83" volumeName="kubernetes.io/projected/7eb43cf3-056c-4372-94b6-dc57ed47dd83-kube-api-access-7sq96" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035757    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="322fa146-852c-4aca-a334-e9ba4e23d8ad" volumeName="kubernetes.io/projected/322fa146-852c-4aca-a334-e9ba4e23d8ad-kube-api-access-m4mxx" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035775    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="008e880d-1e3d-4290-b25f-442ee1d90975" volumeName="kubernetes.io/projected/008e880d-1e3d-4290-b25f-442ee1d90975-kube-api-access-znv57" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035791    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="05bcf726-e398-4201-b974-52406fbdc287" volumeName="kubernetes.io/configmap/05bcf726-e398-4201-b974-52406fbdc287-telemetry-config" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035805    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="207f380c-c390-48c7-8df5-2d828b166284" volumeName="kubernetes.io/empty-dir/207f380c-c390-48c7-8df5-2d828b166284-tmp" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035828    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="207f380c-c390-48c7-8df5-2d828b166284" volumeName="kubernetes.io/projected/207f380c-c390-48c7-8df5-2d828b166284-kube-api-access-xgxnj" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035848    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23e7ce26-ee23-41a7-a925-6fa7c29eda06" volumeName="kubernetes.io/projected/23e7ce26-ee23-41a7-a925-6fa7c29eda06-kube-api-access-8nzs8" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035862    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="45836983-c4ed-4083-886b-07e4c4264527" volumeName="kubernetes.io/configmap/45836983-c4ed-4083-886b-07e4c4264527-config-volume" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035875    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="67e06851-bb40-4be7-87dd-36b84f182f8c" volumeName="kubernetes.io/configmap/67e06851-bb40-4be7-87dd-36b84f182f8c-cni-binary-copy" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035893    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="80f1930a-aa7c-46a0-9a4c-95f35539bf4c" volumeName="kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-bound-sa-token" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035904    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ba0ccc16-d085-4d7f-8df5-e9194ba06f33" volumeName="kubernetes.io/projected/ba0ccc16-d085-4d7f-8df5-e9194ba06f33-kube-api-access-dhjmb" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035922    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0" volumeName="kubernetes.io/projected/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0-kube-api-access-ncgfc" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035935    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="deae1b40-455b-40fd-af9a-c9dfa727a018" volumeName="kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-stats-auth" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035949    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07c431ff-4edd-45b1-b72d-5c3d2b66bfdc" volumeName="kubernetes.io/empty-dir/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-archives-path" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035969    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="16ef1049-ff3e-486a-b565-06aa545c8592" volumeName="kubernetes.io/secret/16ef1049-ff3e-486a-b565-06aa545c8592-signing-key" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.035985    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3bbb4629-dd25-4dae-b2a0-be0099cacaeb" volumeName="kubernetes.io/configmap/3bbb4629-dd25-4dae-b2a0-be0099cacaeb-konnectivity-ca" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036005    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="45836983-c4ed-4083-886b-07e4c4264527" volumeName="kubernetes.io/empty-dir/45836983-c4ed-4083-886b-07e4c4264527-tmp-dir" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036021    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="45836983-c4ed-4083-886b-07e4c4264527" volumeName="kubernetes.io/projected/45836983-c4ed-4083-886b-07e4c4264527-kube-api-access-k98hn" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036035    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0" volumeName="kubernetes.io/secret/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0-serving-cert" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036063    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0155b708-711a-4794-9fd5-bd88e9cae690" volumeName="kubernetes.io/empty-dir/0155b708-711a-4794-9fd5-bd88e9cae690-snapshots" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036085    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="46ab1416-b4cf-4b29-b8b3-38fdf77db001" volumeName="kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036109    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="80f1930a-aa7c-46a0-9a4c-95f35539bf4c" volumeName="kubernetes.io/configmap/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-trusted-ca" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036123    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0" volumeName="kubernetes.io/configmap/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0-config" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036143    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4aa93acd-52e0-4abe-ab94-12c4b3105126" volumeName="kubernetes.io/secret/4aa93acd-52e0-4abe-ab94-12c4b3105126-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036158    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="51b2e157-f1a2-4630-aab9-9ddcd71d5bca" volumeName="kubernetes.io/projected/51b2e157-f1a2-4630-aab9-9ddcd71d5bca-kube-api-access-kzd97" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036177    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07c431ff-4edd-45b1-b72d-5c3d2b66bfdc" volumeName="kubernetes.io/configmap/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-service-ca-bundle" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036192    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="16ef1049-ff3e-486a-b565-06aa545c8592" volumeName="kubernetes.io/configmap/16ef1049-ff3e-486a-b565-06aa545c8592-signing-cabundle" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036207    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="16ef1049-ff3e-486a-b565-06aa545c8592" volumeName="kubernetes.io/projected/16ef1049-ff3e-486a-b565-06aa545c8592-kube-api-access-w79xq" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036224    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="67e06851-bb40-4be7-87dd-36b84f182f8c" volumeName="kubernetes.io/configmap/67e06851-bb40-4be7-87dd-36b84f182f8c-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036236    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3bbb4629-dd25-4dae-b2a0-be0099cacaeb" volumeName="kubernetes.io/secret/3bbb4629-dd25-4dae-b2a0-be0099cacaeb-agent-certs" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036254    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4f3b466e-4894-448e-bc16-a106de5cb14d" volumeName="kubernetes.io/projected/4f3b466e-4894-448e-bc16-a106de5cb14d-kube-api-access-j9nkd" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036266    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="80f1930a-aa7c-46a0-9a4c-95f35539bf4c" volumeName="kubernetes.io/empty-dir/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-ca-trust-extracted" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036279    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4aa93acd-52e0-4abe-ab94-12c4b3105126" volumeName="kubernetes.io/configmap/4aa93acd-52e0-4abe-ab94-12c4b3105126-ovnkube-config" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036295    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed3e2e45-04fe-4fe8-8e88-39439772c950" volumeName="kubernetes.io/projected/ed3e2e45-04fe-4fe8-8e88-39439772c950-kube-api-access-lbqgb" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036307    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0155b708-711a-4794-9fd5-bd88e9cae690" volumeName="kubernetes.io/configmap/0155b708-711a-4794-9fd5-bd88e9cae690-service-ca-bundle" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036324    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4f3b466e-4894-448e-bc16-a106de5cb14d" volumeName="kubernetes.io/configmap/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-config" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036336    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="deae1b40-455b-40fd-af9a-c9dfa727a018" volumeName="kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-default-certificate" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036348    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed3e2e45-04fe-4fe8-8e88-39439772c950" volumeName="kubernetes.io/secret/ed3e2e45-04fe-4fe8-8e88-39439772c950-serving-cert" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036364    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0155b708-711a-4794-9fd5-bd88e9cae690" volumeName="kubernetes.io/empty-dir/0155b708-711a-4794-9fd5-bd88e9cae690-tmp" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036376    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="207f380c-c390-48c7-8df5-2d828b166284" volumeName="kubernetes.io/empty-dir/207f380c-c390-48c7-8df5-2d828b166284-etc-tuned" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036393    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26009c26-16bc-4e82-8246-ebf75fa644e9" volumeName="kubernetes.io/projected/26009c26-16bc-4e82-8246-ebf75fa644e9-kube-api-access-n7p4v" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036404    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="80f1930a-aa7c-46a0-9a4c-95f35539bf4c" volumeName="kubernetes.io/secret/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-installation-pull-secrets" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036420    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e7a138e6-2485-4134-9d3a-c2419d154f30" volumeName="kubernetes.io/projected/e7a138e6-2485-4134-9d3a-c2419d154f30-kube-api-access-wmgxl" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036436    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed3e2e45-04fe-4fe8-8e88-39439772c950" volumeName="kubernetes.io/configmap/ed3e2e45-04fe-4fe8-8e88-39439772c950-config" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036447    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed43211b-ec42-4683-99a6-541bf0a09c7e" volumeName="kubernetes.io/projected/ed43211b-ec42-4683-99a6-541bf0a09c7e-kube-api-access-ww2rj" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036464    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0155b708-711a-4794-9fd5-bd88e9cae690" volumeName="kubernetes.io/projected/0155b708-711a-4794-9fd5-bd88e9cae690-kube-api-access-8g2pl" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036477    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23e7ce26-ee23-41a7-a925-6fa7c29eda06" volumeName="kubernetes.io/configmap/23e7ce26-ee23-41a7-a925-6fa7c29eda06-trusted-ca" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036536    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4aa93acd-52e0-4abe-ab94-12c4b3105126" volumeName="kubernetes.io/configmap/4aa93acd-52e0-4abe-ab94-12c4b3105126-env-overrides" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036554    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6aa78c16-a2a2-4a61-adb7-575224b8ac6f" volumeName="kubernetes.io/projected/6aa78c16-a2a2-4a61-adb7-575224b8ac6f-kube-api-access-c4hvv" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036587    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" volumeName="kubernetes.io/configmap/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-certificates" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036604    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a707ea73-de7e-406f-89ec-9197a6c0f2b5" volumeName="kubernetes.io/projected/a707ea73-de7e-406f-89ec-9197a6c0f2b5-kube-api-access-xk75k" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036619    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd1c3b69-f5f0-415e-a4a1-2be07d7d1887" volumeName="kubernetes.io/configmap/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887-iptables-alerter-script" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036632    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f71c9dd2-5916-4cd5-9aea-6fd70a343419" volumeName="kubernetes.io/projected/f71c9dd2-5916-4cd5-9aea-6fd70a343419-kube-api-access-94wx2" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036649    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07c431ff-4edd-45b1-b72d-5c3d2b66bfdc" volumeName="kubernetes.io/configmap/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 02:55:43.036612 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036661    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d4449be-5ad9-45a2-a708-8935ea16fed1" volumeName="kubernetes.io/configmap/7d4449be-5ad9-45a2-a708-8935ea16fed1-cni-binary-copy" seLinuxMountContext=""
Oct 30 02:55:43.039646 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036678    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="80f1930a-aa7c-46a0-9a4c-95f35539bf4c" volumeName="kubernetes.io/configmap/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-certificates" seLinuxMountContext=""
Oct 30 02:55:43.039646 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036708    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" volumeName="kubernetes.io/empty-dir/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-ca-trust-extracted" seLinuxMountContext=""
Oct 30 02:55:43.039646 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036738    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" volumeName="kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-kube-api-access-br65p" seLinuxMountContext=""
Oct 30 02:55:43.039646 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036756    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="322fa146-852c-4aca-a334-e9ba4e23d8ad" volumeName="kubernetes.io/empty-dir/322fa146-852c-4aca-a334-e9ba4e23d8ad-tmp-dir" seLinuxMountContext=""
Oct 30 02:55:43.039646 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.036768    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23e7ce26-ee23-41a7-a925-6fa7c29eda06" volumeName="kubernetes.io/secret/23e7ce26-ee23-41a7-a925-6fa7c29eda06-serving-cert" seLinuxMountContext=""
Oct 30 02:55:43.039646 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.038135    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26009c26-16bc-4e82-8246-ebf75fa644e9" volumeName="kubernetes.io/secret/26009c26-16bc-4e82-8246-ebf75fa644e9-cert" seLinuxMountContext=""
Oct 30 02:55:43.039646 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.038155    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4aa93acd-52e0-4abe-ab94-12c4b3105126" volumeName="kubernetes.io/projected/4aa93acd-52e0-4abe-ab94-12c4b3105126-kube-api-access-zs8gw" seLinuxMountContext=""
Oct 30 02:55:43.039646 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.038175    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d4449be-5ad9-45a2-a708-8935ea16fed1" volumeName="kubernetes.io/projected/7d4449be-5ad9-45a2-a708-8935ea16fed1-kube-api-access-pnvfv" seLinuxMountContext=""
Oct 30 02:55:43.039646 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.038254    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" volumeName="kubernetes.io/configmap/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-trusted-ca" seLinuxMountContext=""
Oct 30 02:55:43.045707 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.038470    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" volumeName="kubernetes.io/secret/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 02:55:43.045707 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.040945    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b1eeaa36-b8dc-4f8a-81f4-54b22848135d" volumeName="kubernetes.io/empty-dir/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-data-volume" seLinuxMountContext=""
Oct 30 02:55:43.045707 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.040981    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0155b708-711a-4794-9fd5-bd88e9cae690" volumeName="kubernetes.io/configmap/0155b708-711a-4794-9fd5-bd88e9cae690-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 02:55:43.045707 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.041030    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07c431ff-4edd-45b1-b72d-5c3d2b66bfdc" volumeName="kubernetes.io/projected/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-kube-api-access-jb76r" seLinuxMountContext=""
Oct 30 02:55:43.045707 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.041042    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23e7ce26-ee23-41a7-a925-6fa7c29eda06" volumeName="kubernetes.io/configmap/23e7ce26-ee23-41a7-a925-6fa7c29eda06-config" seLinuxMountContext=""
Oct 30 02:55:43.045707 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.041056    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" volumeName="kubernetes.io/secret/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-installation-pull-secrets" seLinuxMountContext=""
Oct 30 02:55:43.045707 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.041069    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd1c3b69-f5f0-415e-a4a1-2be07d7d1887" volumeName="kubernetes.io/projected/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887-kube-api-access-q2pmx" seLinuxMountContext=""
Oct 30 02:55:43.045707 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.041080    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc" volumeName="kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret" seLinuxMountContext=""
Oct 30 02:55:43.045707 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.041094    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="05bcf726-e398-4201-b974-52406fbdc287" volumeName="kubernetes.io/projected/05bcf726-e398-4201-b974-52406fbdc287-kube-api-access-g92lj" seLinuxMountContext=""
Oct 30 02:55:43.045707 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.041108    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="67e06851-bb40-4be7-87dd-36b84f182f8c" volumeName="kubernetes.io/configmap/67e06851-bb40-4be7-87dd-36b84f182f8c-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 02:55:43.045707 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.041120    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d4449be-5ad9-45a2-a708-8935ea16fed1" volumeName="kubernetes.io/configmap/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-daemon-config" seLinuxMountContext=""
Oct 30 02:55:43.045707 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.041132    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="80f1930a-aa7c-46a0-9a4c-95f35539bf4c" volumeName="kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-kube-api-access-t8c9g" seLinuxMountContext=""
Oct 30 02:55:43.045707 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.041144    5068 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b1eeaa36-b8dc-4f8a-81f4-54b22848135d" volumeName="kubernetes.io/projected/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-api-access-mlm47" seLinuxMountContext=""
Oct 30 02:55:43.045707 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.041155    5068 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 02:55:43.045707 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.041189    5068 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 02:55:43.051174 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.051157    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/1.log"
Oct 30 02:55:43.051776 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.051757    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/1.log"
Oct 30 02:55:43.063902 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.063855    5068 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 02:55:43.065486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.065465    5068 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 02:55:43.065486 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.065487    5068 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 02:55:43.065589 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.065508    5068 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 02:55:43.065589 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:43.065550    5068 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 02:55:43.071032 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.071007    5068 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:55:43.071134 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.071099    5068 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 02:55:43.079365 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.079346    5068 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:55:43.079585 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.079557    5068 generic.go:356] "Generic (PLEG): container finished" podID="67e06851-bb40-4be7-87dd-36b84f182f8c" containerID="bd78a5a6c1613ec730994d56d052b92e08ca6adec81135a88d825867569ba621" exitCode=0
Oct 30 02:55:43.079659 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.079587    5068 generic.go:356] "Generic (PLEG): container finished" podID="67e06851-bb40-4be7-87dd-36b84f182f8c" containerID="26424f6a6746146800a0a1c14c9a3f84164bac7e531eeb721f2032dec400f7de" exitCode=0
Oct 30 02:55:43.079659 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.079598    5068 generic.go:356] "Generic (PLEG): container finished" podID="67e06851-bb40-4be7-87dd-36b84f182f8c" containerID="7b2c329d9b440d46e9b9adefbf1872633e77e5e725b00656142a00866402ad8e" exitCode=0
Oct 30 02:55:43.079659 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.079607    5068 generic.go:356] "Generic (PLEG): container finished" podID="67e06851-bb40-4be7-87dd-36b84f182f8c" containerID="11166a861b0ef756acc4aec37cdf8db10826448f076310d6f652ed977c796913" exitCode=0
Oct 30 02:55:43.079659 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.079615    5068 generic.go:356] "Generic (PLEG): container finished" podID="67e06851-bb40-4be7-87dd-36b84f182f8c" containerID="b001a1646111a0668d0220ecafc2f2f066493167bc19425a92b152aed0baeaee" exitCode=0
Oct 30 02:55:43.079659 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.079620    5068 generic.go:356] "Generic (PLEG): container finished" podID="67e06851-bb40-4be7-87dd-36b84f182f8c" containerID="27788d67cdc8513a515a862327c004c99f2fe839ac8a6b9dc74737dfa762104a" exitCode=0
Oct 30 02:55:43.081602 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.081579    5068 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:55:43.082035 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.082015    5068 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:55:43.110660 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.110597    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/1.log"
Oct 30 02:55:43.110660 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.110626    5068 generic.go:356] "Generic (PLEG): container finished" podID="23e7ce26-ee23-41a7-a925-6fa7c29eda06" containerID="40feda09fb99d9862f6d8156d3ed4f38964693e1f22005c2ea9663219677ee9f" exitCode=255
Oct 30 02:55:43.119877 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.119850    5068 generic.go:356] "Generic (PLEG): container finished" podID="1e8aeea066a252cd4be40281f35c3f01" containerID="d5e5e684027962e131d6cd504f76252abb3e21095bd9bd23e2a4354120993ecc" exitCode=0
Oct 30 02:55:43.142875 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.142851    5068 manager.go:324] Recovery completed
Oct 30 02:55:43.162917 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.162892    5068 cpu_manager.go:226] "Starting" policy="none"
Oct 30 02:55:43.162917 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.162908    5068 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 02:55:43.163026 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.162924    5068 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 02:55:43.163055 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.163033    5068 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 02:55:43.163478 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.163044    5068 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 02:55:43.163523 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.163480    5068 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 02:55:43.163523 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.163487    5068 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 02:55:43.163523 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.163492    5068 policy_none.go:50] "Start"
Oct 30 02:55:43.163523 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.163502    5068 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 02:55:43.163523 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.163514    5068 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 02:55:43.163651 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.163634    5068 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 02:55:43.163651 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.163641    5068 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 02:55:43.163651 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.163646    5068 policy_none.go:44] "Start"
Oct 30 02:55:43.165794 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:43.165772    5068 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 30 02:55:43.167917 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.167888    5068 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 02:55:43.170661 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.170639    5068 manager.go:341] "Starting Device Plugin manager"
Oct 30 02:55:43.170748 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:43.170671    5068 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 02:55:43.170748 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.170681    5068 server.go:87] "Starting device plugin registration server"
Oct 30 02:55:43.170990 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.170976    5068 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 02:55:43.171041 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.170990    5068 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 02:55:43.171095 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.171076    5068 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 02:55:43.171228 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.171186    5068 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 02:55:43.171300 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.171236    5068 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 02:55:43.171300 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.171242    5068 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 02:55:43.171367 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.171293    5068 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T02:55:43.17122646Z","UUID":"f4fcc76c-df00-45f1-b7eb-9575b98b3703","Handler":null,"Name":"","Endpoint":""}
Oct 30 02:55:43.172948 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.172837    5068 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 02:55:43.173205 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.173193    5068 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 02:55:43.174041 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:43.174014    5068 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 02:55:43.271385 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.271359    5068 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:55:43.272516 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.272498    5068 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:55:43.272593 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.272528    5068 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:55:43.272593 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.272538    5068 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-40.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:55:43.272593 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.272585    5068 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-139-40.ec2.internal"
Oct 30 02:55:43.307218 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.307196    5068 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-139-40.ec2.internal"
Oct 30 02:55:43.307304 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.307257    5068 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-139-40.ec2.internal"
Oct 30 02:55:43.366395 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.366312    5068 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-40.ec2.internal"]
Oct 30 02:55:43.366914 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.366886    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-40.ec2.internal" event={"ID":"13718fab620286fdb285c77e4037fd98","Type":"ContainerStarted","Data":"6b1f8e46990e67d97d1b60840a459a87a295ef7b3dcbb27d3e1b09710dcd96a0"}
Oct 30 02:55:43.366982 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.366921    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-40.ec2.internal" event={"ID":"13718fab620286fdb285c77e4037fd98","Type":"ContainerStarted","Data":"86839444e77438014c85f53a8092c7ecbe477e631c2e6af015d7e2488be31ee4"}
Oct 30 02:55:43.366982 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.366971    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal" event={"ID":"1e8aeea066a252cd4be40281f35c3f01","Type":"ContainerStarted","Data":"bf64b706b4dc03eeaa9de2aab391ecd8fcfeefb0cfefcb23655e533f38ce6b66"}
Oct 30 02:55:43.367070 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.366983    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal" event={"ID":"1e8aeea066a252cd4be40281f35c3f01","Type":"ContainerDied","Data":"d5e5e684027962e131d6cd504f76252abb3e21095bd9bd23e2a4354120993ecc"}
Oct 30 02:55:43.367070 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.366998    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal" event={"ID":"1e8aeea066a252cd4be40281f35c3f01","Type":"ContainerStarted","Data":"54be5e07d8720fe6aa36a70fc66f11286429e336b21da6f6087d0c203d29f802"}
Oct 30 02:55:43.367070 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.366904    5068 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:43.367207 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.367075    5068 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:43.396286 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.396260    5068 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 02:55:43.396380 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:43.396311    5068 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-139-40.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:43.400913 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.400898    5068 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 02:55:43.400965 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:43.400932    5068 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:43.472275 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.472250    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13718fab620286fdb285c77e4037fd98-config\") pod \"kube-apiserver-proxy-ip-10-0-139-40.ec2.internal\" (UID: \"13718fab620286fdb285c77e4037fd98\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:43.472375 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.472312    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1e8aeea066a252cd4be40281f35c3f01-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal\" (UID: \"1e8aeea066a252cd4be40281f35c3f01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:43.472411 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.472372    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e8aeea066a252cd4be40281f35c3f01-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal\" (UID: \"1e8aeea066a252cd4be40281f35c3f01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:43.573102 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.573069    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1e8aeea066a252cd4be40281f35c3f01-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal\" (UID: \"1e8aeea066a252cd4be40281f35c3f01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:43.573102 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.573101    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e8aeea066a252cd4be40281f35c3f01-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal\" (UID: \"1e8aeea066a252cd4be40281f35c3f01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:43.573284 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.573118    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13718fab620286fdb285c77e4037fd98-config\") pod \"kube-apiserver-proxy-ip-10-0-139-40.ec2.internal\" (UID: \"13718fab620286fdb285c77e4037fd98\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:43.573284 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.573168    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13718fab620286fdb285c77e4037fd98-config\") pod \"kube-apiserver-proxy-ip-10-0-139-40.ec2.internal\" (UID: \"13718fab620286fdb285c77e4037fd98\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:43.573284 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.573186    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1e8aeea066a252cd4be40281f35c3f01-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal\" (UID: \"1e8aeea066a252cd4be40281f35c3f01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:43.573284 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:43.573185    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e8aeea066a252cd4be40281f35c3f01-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal\" (UID: \"1e8aeea066a252cd4be40281f35c3f01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:44.014141 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.014108    5068 apiserver.go:52] "Watching apiserver"
Oct 30 02:55:44.133590 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.133552    5068 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:44.134481 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.134457    5068 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 02:55:44.135127 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.135098    5068 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-67f9ffd857-gnqzw","openshift-ingress-canary/ingress-canary-xqnbh","openshift-multus/multus-cvsmc","openshift-image-registry/image-registry-88cb97fb-qnc8x","openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd","openshift-network-operator/iptables-alerter-twcgj","openshift-ovn-kubernetes/ovnkube-node-rpbtg","openshift-service-ca/service-ca-5fffc97bdf-2xft4","openshift-network-diagnostics/network-check-target-p7mkl","openshift-insights/insights-operator-7c4986d449-kss29","kube-system/konnectivity-agent-7jm4j","openshift-console-operator/console-operator-7cd56b8dbc-glqfz","openshift-image-registry/node-ca-s8pxs","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cxwq4","kube-system/global-pull-secret-syncer-lg4vm","openshift-multus/network-metrics-daemon-zxzxk","openshift-dns/dns-default-ftq8q","openshift-kube-storage-version-migrator/migrator-66df5d496b-rrzgh","openshift-dns/node-resolver-ttjnv","openshift-cluster-node-tuning-operator/tuned-w29gr","openshift-kube-storage-version-migrator/migrator-66df5d496b-ql7f5","kube-system/kas-connection-checker-685895c7c9-fvrpn","openshift-network-console/networking-console-plugin-86c478bb88-jkkwx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz","openshift-image-registry/image-registry-57b8cd6f65-mwg8n","openshift-multus/multus-additional-cni-plugins-r6frn","openshift-insights/periodic-gathering-bf2qb-x5rb9","openshift-network-diagnostics/network-check-source-6f78d59f99-v5ppj","kube-system/kube-apiserver-proxy-ip-10-0-139-40.ec2.internal","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522","openshift-insights/insights-runtime-extractor-9jzff","openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj","kube-system/kas-connection-checker-685895c7c9-dtw44","kube-system/kas-connection-checker-685895c7c9-sppcg"]
Oct 30 02:55:44.136757 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.136732    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:44.137324 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.137304    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:44.138276 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.138257    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:44.139019 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.139002    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:44.139431 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.139414    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"
Oct 30 02:55:44.142965 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.142948    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:44.145702 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.145669    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:44.146313 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.146299    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:44.147392 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.147374    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:44.151525 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.151504    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 02:55:44.153520 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.153502    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:44.153599 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.153565    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 02:55:44.153651 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.153626    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 02:55:44.153755 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.153744    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:44.154250 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.154230    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:44.154365 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.154248    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:44.154365 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.154240    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 02:55:44.154365 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.154312    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 02:55:44.154844 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.154823    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 02:55:44.155639 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.155618    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 02:55:44.155712 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.155641    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 02:55:44.155712 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.155666    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 02:55:44.156180 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.156165    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 02:55:44.156646 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.156625    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 02:55:44.156739 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.156655    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:44.156739 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.156661    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 02:55:44.156739 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.156700    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 02:55:44.156739 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.156725    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:44.156886 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.156814    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 02:55:44.156886 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.156836    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:44.156964 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.156925    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 02:55:44.157001 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.156959    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 02:55:44.157001 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.156972    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 02:55:44.157111 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.157096    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:44.157506 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.157491    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:44.157775 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.157762    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 02:55:44.158455 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.158435    5068 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 02:55:44.158517 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.158435    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:44.158517 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.158494    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 02:55:44.158517 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.158500    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 02:55:44.158644 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.158516    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 02:55:44.158644 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.158523    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 02:55:44.158644 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.158517    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 02:55:44.158763 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.158652    5068 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-40.ec2.internal"
Oct 30 02:55:44.158817 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.158449    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 02:55:44.159345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.159327    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 02:55:44.159434 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.159350    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gjrvb\""
Oct 30 02:55:44.163945 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.163931    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 02:55:44.165672 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.165655    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 02:55:44.165749 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.165739    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 02:55:44.165926 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.165913    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 02:55:44.165956 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.165919    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fm748\""
Oct 30 02:55:44.167080 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.167065    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 02:55:44.167123 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.167114    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 02:55:44.167169 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.167135    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-qtb58\""
Oct 30 02:55:44.167169 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.167164    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 02:55:44.167254 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.167176    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 02:55:44.167254 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.167195    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 02:55:44.167254 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.167199    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 02:55:44.167751 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.167738    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 02:55:44.168069 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.168056    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 02:55:44.168069 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.168064    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 02:55:44.168137 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.168104    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:44.168733 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.168718    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 02:55:44.168770 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.168745    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 02:55:44.169826 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.169805    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 02:55:44.170920 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.170902    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 02:55:44.170977 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.170903    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 02:55:44.173230 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.173212    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 02:55:44.173311 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.173221    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 02:55:44.173311 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.173221    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 02:55:44.173311 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.173259    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:44.173311 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.173269    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 02:55:44.173467 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.173323    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 02:55:44.173467 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.173330    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 02:55:44.173606 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.173587    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 02:55:44.173980 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.173963    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 02:55:44.174113 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.174094    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 02:55:44.174188 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.174140    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:44.174241 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.174205    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 02:55:44.174367 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.174347    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 02:55:44.174478 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.174378    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 02:55:44.175833 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.175817    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 02:55:44.175972 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.175850    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 02:55:44.176084 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.176062    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 02:55:44.176084 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.176067    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 02:55:44.176147 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.176121    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 02:55:44.176321 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.176306    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 02:55:44.176378 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.176326    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-65dst\""
Oct 30 02:55:44.176378 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.176338    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 02:55:44.176378 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.176372    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cth5s\""
Oct 30 02:55:44.177194 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.177161    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 02:55:44.177269 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.177204    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Oct 30 02:55:44.177269 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.177221    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Oct 30 02:55:44.177269 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.177236    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Oct 30 02:55:44.177269 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.177237    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Oct 30 02:55:44.177269 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.177246    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 02:55:44.177630 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.177389    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 02:55:44.177630 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.177419    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ndvn4\""
Oct 30 02:55:44.177630 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.177422    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 02:55:44.177630 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.177437    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lx7sd\""
Oct 30 02:55:44.177630 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.177450    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 02:55:44.177630 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.177507    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qr586\""
Oct 30 02:55:44.177630 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.177528    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q4rkf\""
Oct 30 02:55:44.177630 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.177561    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-q2qrw\""
Oct 30 02:55:44.178127 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.178108    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-pchn6\""
Oct 30 02:55:44.178224 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.178138    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5kvz4\""
Oct 30 02:55:44.178224 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.178197    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-44jtl\""
Oct 30 02:55:44.178224 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.178205    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 02:55:44.178224 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.178211    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 02:55:44.178392 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.178236    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-vcctk\""
Oct 30 02:55:44.178392 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.178206    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-726c9\""
Oct 30 02:55:44.178392 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.178253    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dfxcf\""
Oct 30 02:55:44.178392 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.178213    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q5wfc\""
Oct 30 02:55:44.178392 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.178312    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pz2d6\""
Oct 30 02:55:44.178392 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.178267    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lqw84\""
Oct 30 02:55:44.178392 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.178238    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-s7n2w\""
Oct 30 02:55:44.178392 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.178257    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-l5vxm\""
Oct 30 02:55:44.229401 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.229378    5068 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 02:55:44.276762 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.276705    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-systemd-units\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.276762 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.276742    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-run-openvswitch\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.276903 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.276766    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45836983-c4ed-4083-886b-07e4c4264527-tmp-dir\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:44.276903 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.276823    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znv57\" (UniqueName: \"kubernetes.io/projected/008e880d-1e3d-4290-b25f-442ee1d90975-kube-api-access-znv57\") pod \"kas-connection-checker-685895c7c9-fvrpn\" (UID: \"008e880d-1e3d-4290-b25f-442ee1d90975\") " pod="kube-system/kas-connection-checker-685895c7c9-fvrpn"
Oct 30 02:55:44.276903 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.276853    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-kubernetes\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.276903 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.276876    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-metrics-certs\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:44.276903 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.276895    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhjmb\" (UniqueName: \"kubernetes.io/projected/ba0ccc16-d085-4d7f-8df5-e9194ba06f33-kube-api-access-dhjmb\") pod \"migrator-66df5d496b-ql7f5\" (UID: \"ba0ccc16-d085-4d7f-8df5-e9194ba06f33\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-ql7f5"
Oct 30 02:55:44.277084 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.276914    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-var-lib-cni-bin\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.277084 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.276927    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45836983-c4ed-4083-886b-07e4c4264527-tmp-dir\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:44.277084 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.276934    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23e7ce26-ee23-41a7-a925-6fa7c29eda06-trusted-ca\") pod \"console-operator-7cd56b8dbc-glqfz\" (UID: \"23e7ce26-ee23-41a7-a925-6fa7c29eda06\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:44.277084 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.277058    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67e06851-bb40-4be7-87dd-36b84f182f8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:44.277084 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.277079    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncgfc\" (UniqueName: \"kubernetes.io/projected/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0-kube-api-access-ncgfc\") pod \"service-ca-operator-544d749c8c-7j4nj\" (UID: \"d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj"
Oct 30 02:55:44.277291 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.277134    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-var-lib-kubelet\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.277291 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.277172    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-socket-dir-parent\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.277291 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.277200    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-run-multus-certs\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.277291 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.277259    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23e7ce26-ee23-41a7-a925-6fa7c29eda06-trusted-ca\") pod \"console-operator-7cd56b8dbc-glqfz\" (UID: \"23e7ce26-ee23-41a7-a925-6fa7c29eda06\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:44.277422 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.277327    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sq96\" (UniqueName: \"kubernetes.io/projected/7eb43cf3-056c-4372-94b6-dc57ed47dd83-kube-api-access-7sq96\") pod \"network-check-source-6f78d59f99-v5ppj\" (UID: \"7eb43cf3-056c-4372-94b6-dc57ed47dd83\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-v5ppj"
Oct 30 02:55:44.277532 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.277351    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g92lj\" (UniqueName: \"kubernetes.io/projected/05bcf726-e398-4201-b974-52406fbdc287-kube-api-access-g92lj\") pod \"cluster-monitoring-operator-884576c57-9d2rd\" (UID: \"05bcf726-e398-4201-b974-52406fbdc287\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:44.277834 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.277808    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67e06851-bb40-4be7-87dd-36b84f182f8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:44.278045 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278011    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-ca-trust-extracted\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:44.278142 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278068    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-ca-trust-extracted\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:44.278222 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278139    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3bbb4629-dd25-4dae-b2a0-be0099cacaeb-agent-certs\") pod \"konnectivity-agent-7jm4j\" (UID: \"3bbb4629-dd25-4dae-b2a0-be0099cacaeb\") " pod="kube-system/konnectivity-agent-7jm4j"
Oct 30 02:55:44.278222 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278181    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:44.278331 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278221    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:44.278331 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278259    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-etc-kubernetes\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.278331 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278298    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-installation-pull-secrets\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:44.278479 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278329    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-crio-socket\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:44.278479 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278369    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-lib-modules\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.278479 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278404    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-cni-bin\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.278479 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278438    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/16ef1049-ff3e-486a-b565-06aa545c8592-signing-cabundle\") pod \"service-ca-5fffc97bdf-2xft4\" (UID: \"16ef1049-ff3e-486a-b565-06aa545c8592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-2xft4"
Oct 30 02:55:44.278479 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278473    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0155b708-711a-4794-9fd5-bd88e9cae690-service-ca-bundle\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:44.278725 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278501    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-data-volume\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:44.278725 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278535    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:44.278725 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278571    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-sysconfig\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.278725 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278602    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-slash\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.278725 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278635    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4aa93acd-52e0-4abe-ab94-12c4b3105126-ovn-node-metrics-cert\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.278725 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278673    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs8gw\" (UniqueName: \"kubernetes.io/projected/4aa93acd-52e0-4abe-ab94-12c4b3105126-kube-api-access-zs8gw\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.279052 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278728    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-bound-sa-token\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:44.279052 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278770    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0-serving-cert\") pod \"service-ca-operator-544d749c8c-7j4nj\" (UID: \"d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj"
Oct 30 02:55:44.279052 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278855    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0-config\") pod \"service-ca-operator-544d749c8c-7j4nj\" (UID: \"d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj"
Oct 30 02:55:44.279052 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278892    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-modprobe-d\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.279052 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278937    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk75k\" (UniqueName: \"kubernetes.io/projected/a707ea73-de7e-406f-89ec-9197a6c0f2b5-kube-api-access-xk75k\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:44.279052 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.278970    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-systemd\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.279052 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.279002    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/322fa146-852c-4aca-a334-e9ba4e23d8ad-tmp-dir\") pod \"node-resolver-ttjnv\" (UID: \"322fa146-852c-4aca-a334-e9ba4e23d8ad\") " pod="openshift-dns/node-resolver-ttjnv"
Oct 30 02:55:44.279052 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.279034    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-run-systemd\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.279385 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.279066    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-run-ovn-kubernetes\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.279436 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.279419    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4aa93acd-52e0-4abe-ab94-12c4b3105126-ovn-node-metrics-cert\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.279508 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.279468    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-data-volume\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:44.279568 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.279542    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3bbb4629-dd25-4dae-b2a0-be0099cacaeb-agent-certs\") pod \"konnectivity-agent-7jm4j\" (UID: \"3bbb4629-dd25-4dae-b2a0-be0099cacaeb\") " pod="kube-system/konnectivity-agent-7jm4j"
Oct 30 02:55:44.279642 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.279620    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/16ef1049-ff3e-486a-b565-06aa545c8592-signing-cabundle\") pod \"service-ca-5fffc97bdf-2xft4\" (UID: \"16ef1049-ff3e-486a-b565-06aa545c8592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-2xft4"
Oct 30 02:55:44.279940 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.279433    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-installation-pull-secrets\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:44.279940 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.279930    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-device-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:44.280293 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.280275    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0155b708-711a-4794-9fd5-bd88e9cae690-service-ca-bundle\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:44.280371 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.280355    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/322fa146-852c-4aca-a334-e9ba4e23d8ad-tmp-dir\") pod \"node-resolver-ttjnv\" (UID: \"322fa146-852c-4aca-a334-e9ba4e23d8ad\") " pod="openshift-dns/node-resolver-ttjnv"
Oct 30 02:55:44.280444 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.280374    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0-serving-cert\") pod \"service-ca-operator-544d749c8c-7j4nj\" (UID: \"d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj"
Oct 30 02:55:44.280444 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.280419    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-stats-auth\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:44.280539 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.280474    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/05bcf726-e398-4201-b974-52406fbdc287-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-9d2rd\" (UID: \"05bcf726-e398-4201-b974-52406fbdc287\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:44.280584 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.280570    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4aa93acd-52e0-4abe-ab94-12c4b3105126-ovnkube-config\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.280677 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.280660    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-etc-selinux\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:44.280765 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.280722    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-stats-auth\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:44.280765 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.280732    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-system-cni-dir\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.280849 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.280796    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-var-lib-kubelet\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.280849 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.280834    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67e06851-bb40-4be7-87dd-36b84f182f8c-system-cni-dir\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:44.280938 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.280871    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-host\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.280938 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.280903    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-var-lib-openvswitch\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.281026 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.280963    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-run-ovn\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.281026 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.280997    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnvfv\" (UniqueName: \"kubernetes.io/projected/7d4449be-5ad9-45a2-a708-8935ea16fed1-kube-api-access-pnvfv\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.281106 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281028    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0155b708-711a-4794-9fd5-bd88e9cae690-snapshots\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:44.281106 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281061    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:44.281106 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281085    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-dbus\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:44.281259 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281117    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-bound-sa-token\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:44.281259 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281148    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67e06851-bb40-4be7-87dd-36b84f182f8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:44.281259 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281162    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0-config\") pod \"service-ca-operator-544d749c8c-7j4nj\" (UID: \"d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj"
Oct 30 02:55:44.281259 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281180    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlm47\" (UniqueName: \"kubernetes.io/projected/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-api-access-mlm47\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:44.281442 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281315    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0155b708-711a-4794-9fd5-bd88e9cae690-snapshots\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:44.281442 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281357    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2-host\") pod \"node-ca-s8pxs\" (UID: \"dec5346e-cd73-40b5-bcf4-05bc1a7e33e2\") " pod="openshift-image-registry/node-ca-s8pxs"
Oct 30 02:55:44.281442 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281399    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:44.281442 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281438    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887-host-slash\") pod \"iptables-alerter-twcgj\" (UID: \"bd1c3b69-f5f0-415e-a4a1-2be07d7d1887\") " pod="openshift-network-operator/iptables-alerter-twcgj"
Oct 30 02:55:44.281626 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281451    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4aa93acd-52e0-4abe-ab94-12c4b3105126-ovnkube-config\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.281626 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281474    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0155b708-711a-4794-9fd5-bd88e9cae690-tmp\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:44.281626 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281612    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0155b708-711a-4794-9fd5-bd88e9cae690-tmp\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:44.281777 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281756    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-default-certificate\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:44.281838 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281799    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-service-ca-bundle\") pod \"periodic-gathering-bf2qb-x5rb9\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") " pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:44.281897 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281833    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzd97\" (UniqueName: \"kubernetes.io/projected/51b2e157-f1a2-4630-aab9-9ddcd71d5bca-kube-api-access-kzd97\") pod \"kas-connection-checker-685895c7c9-sppcg\" (UID: \"51b2e157-f1a2-4630-aab9-9ddcd71d5bca\") " pod="kube-system/kas-connection-checker-685895c7c9-sppcg"
Oct 30 02:55:44.281897 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281869    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs\") pod \"network-metrics-daemon-zxzxk\" (UID: \"e7a138e6-2485-4134-9d3a-c2419d154f30\") " pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:44.281993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281893    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-sys\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.281993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281929    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-original-pull-secret\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:44.281993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.281955    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/207f380c-c390-48c7-8df5-2d828b166284-tmp\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.282130 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.282039    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/207f380c-c390-48c7-8df5-2d828b166284-tmp\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.282293 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.282274    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-default-certificate\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:44.282510 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.282492    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-service-ca-bundle\") pod \"periodic-gathering-bf2qb-x5rb9\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") " pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:44.282754 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.282737    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-run-netns\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.282850 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.282782    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887-iptables-alerter-script\") pod \"iptables-alerter-twcgj\" (UID: \"bd1c3b69-f5f0-415e-a4a1-2be07d7d1887\") " pod="openshift-network-operator/iptables-alerter-twcgj"
Oct 30 02:55:44.282972 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.282955    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-run-netns\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.283027 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.282986    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-var-lib-cni-multus\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.283027 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283015    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-image-registry-private-configuration\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:44.283119 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283038    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-trusted-ca\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:44.283119 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283078    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-zw522\" (UID: \"4f3b466e-4894-448e-bc16-a106de5cb14d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:44.283215 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283145    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/16ef1049-ff3e-486a-b565-06aa545c8592-signing-key\") pod \"service-ca-5fffc97bdf-2xft4\" (UID: \"16ef1049-ff3e-486a-b565-06aa545c8592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-2xft4"
Oct 30 02:55:44.283215 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283157    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887-iptables-alerter-script\") pod \"iptables-alerter-twcgj\" (UID: \"bd1c3b69-f5f0-415e-a4a1-2be07d7d1887\") " pod="openshift-network-operator/iptables-alerter-twcgj"
Oct 30 02:55:44.283215 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283189    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:44.283348 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283225    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0155b708-711a-4794-9fd5-bd88e9cae690-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:44.283348 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283261    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7p4v\" (UniqueName: \"kubernetes.io/projected/26009c26-16bc-4e82-8246-ebf75fa644e9-kube-api-access-n7p4v\") pod \"ingress-canary-xqnbh\" (UID: \"26009c26-16bc-4e82-8246-ebf75fa644e9\") " pod="openshift-ingress-canary/ingress-canary-xqnbh"
Oct 30 02:55:44.283348 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283334    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:44.283485 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283376    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drz2l\" (UniqueName: \"kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l\") pod \"network-check-target-p7mkl\" (UID: \"46ab1416-b4cf-4b29-b8b3-38fdf77db001\") " pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:44.283485 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283454    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-zw522\" (UID: \"4f3b466e-4894-448e-bc16-a106de5cb14d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:44.283485 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283472    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/16ef1049-ff3e-486a-b565-06aa545c8592-signing-key\") pod \"service-ca-5fffc97bdf-2xft4\" (UID: \"16ef1049-ff3e-486a-b565-06aa545c8592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-2xft4"
Oct 30 02:55:44.283634 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283493    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2-serviceca\") pod \"node-ca-s8pxs\" (UID: \"dec5346e-cd73-40b5-bcf4-05bc1a7e33e2\") " pod="openshift-image-registry/node-ca-s8pxs"
Oct 30 02:55:44.283634 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283521    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww2rj\" (UniqueName: \"kubernetes.io/projected/ed43211b-ec42-4683-99a6-541bf0a09c7e-kube-api-access-ww2rj\") pod \"migrator-66df5d496b-rrzgh\" (UID: \"ed43211b-ec42-4683-99a6-541bf0a09c7e\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-rrzgh"
Oct 30 02:55:44.283634 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283544    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67e06851-bb40-4be7-87dd-36b84f182f8c-cnibin\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:44.283784 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283671    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2-serviceca\") pod \"node-ca-s8pxs\" (UID: \"dec5346e-cd73-40b5-bcf4-05bc1a7e33e2\") " pod="openshift-image-registry/node-ca-s8pxs"
Oct 30 02:55:44.283784 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283673    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-trusted-ca\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:44.283784 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283728    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmgxl\" (UniqueName: \"kubernetes.io/projected/e7a138e6-2485-4134-9d3a-c2419d154f30-kube-api-access-wmgxl\") pod \"network-metrics-daemon-zxzxk\" (UID: \"e7a138e6-2485-4134-9d3a-c2419d154f30\") " pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:44.283784 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283777    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-image-registry-private-configuration\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:44.283968 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283783    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-etc-openvswitch\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.283968 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283739    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0155b708-711a-4794-9fd5-bd88e9cae690-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:44.283968 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283851    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-node-log\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.283968 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.283931    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-zw522\" (UID: \"4f3b466e-4894-448e-bc16-a106de5cb14d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:44.284344 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.284327    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d4449be-5ad9-45a2-a708-8935ea16fed1-cni-binary-copy\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.284390 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.284374    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/67e06851-bb40-4be7-87dd-36b84f182f8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:44.284503 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.284484    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4hvv\" (UniqueName: \"kubernetes.io/projected/6aa78c16-a2a2-4a61-adb7-575224b8ac6f-kube-api-access-c4hvv\") pod \"volume-data-source-validator-58c9f5f46d-cxwq4\" (UID: \"6aa78c16-a2a2-4a61-adb7-575224b8ac6f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cxwq4"
Oct 30 02:55:44.284596 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.284573    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26009c26-16bc-4e82-8246-ebf75fa644e9-cert\") pod \"ingress-canary-xqnbh\" (UID: \"26009c26-16bc-4e82-8246-ebf75fa644e9\") " pod="openshift-ingress-canary/ingress-canary-xqnbh"
Oct 30 02:55:44.284705 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.284609    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d4449be-5ad9-45a2-a708-8935ea16fed1-cni-binary-copy\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.284705 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.284621    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/67e06851-bb40-4be7-87dd-36b84f182f8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:44.284814 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.284706    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-run\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.284867 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.284828    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4aa93acd-52e0-4abe-ab94-12c4b3105126-env-overrides\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.284920 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.284885    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26009c26-16bc-4e82-8246-ebf75fa644e9-cert\") pod \"ingress-canary-xqnbh\" (UID: \"26009c26-16bc-4e82-8246-ebf75fa644e9\") " pod="openshift-ingress-canary/ingress-canary-xqnbh"
Oct 30 02:55:44.284920 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.284878    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-cni-dir\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.285011 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.284997    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/05bcf726-e398-4201-b974-52406fbdc287-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-9d2rd\" (UID: \"05bcf726-e398-4201-b974-52406fbdc287\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:44.285042 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285006    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4aa93acd-52e0-4abe-ab94-12c4b3105126-env-overrides\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.285075 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285041    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4mxx\" (UniqueName: \"kubernetes.io/projected/322fa146-852c-4aca-a334-e9ba4e23d8ad-kube-api-access-m4mxx\") pod \"node-resolver-ttjnv\" (UID: \"322fa146-852c-4aca-a334-e9ba4e23d8ad\") " pod="openshift-dns/node-resolver-ttjnv"
Oct 30 02:55:44.285160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285143    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3e2e45-04fe-4fe8-8e88-39439772c950-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz\" (UID: \"ed3e2e45-04fe-4fe8-8e88-39439772c950\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz"
Oct 30 02:55:44.285234 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285215    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/744bf9e1-3e8b-402c-863a-331a6786f85c-nginx-conf\") pod \"networking-console-plugin-86c478bb88-jkkwx\" (UID: \"744bf9e1-3e8b-402c-863a-331a6786f85c\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"
Oct 30 02:55:44.285234 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285218    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/05bcf726-e398-4201-b974-52406fbdc287-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-9d2rd\" (UID: \"05bcf726-e398-4201-b974-52406fbdc287\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:44.285310 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285261    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:44.285360 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285328    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nzs8\" (UniqueName: \"kubernetes.io/projected/23e7ce26-ee23-41a7-a925-6fa7c29eda06-kube-api-access-8nzs8\") pod \"console-operator-7cd56b8dbc-glqfz\" (UID: \"23e7ce26-ee23-41a7-a925-6fa7c29eda06\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:44.285415 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285396    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/744bf9e1-3e8b-402c-863a-331a6786f85c-nginx-conf\") pod \"networking-console-plugin-86c478bb88-jkkwx\" (UID: \"744bf9e1-3e8b-402c-863a-331a6786f85c\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"
Oct 30 02:55:44.285476 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285461    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-sysctl-conf\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.285526 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285497    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3e2e45-04fe-4fe8-8e88-39439772c950-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz\" (UID: \"ed3e2e45-04fe-4fe8-8e88-39439772c950\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz"
Oct 30 02:55:44.285526 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285498    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-cni-netd\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.285615 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285535    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ed3e2e45-04fe-4fe8-8e88-39439772c950-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz\" (UID: \"ed3e2e45-04fe-4fe8-8e88-39439772c950\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz"
Oct 30 02:55:44.285615 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285568    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbqgb\" (UniqueName: \"kubernetes.io/projected/ed3e2e45-04fe-4fe8-8e88-39439772c950-kube-api-access-lbqgb\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz\" (UID: \"ed3e2e45-04fe-4fe8-8e88-39439772c950\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz"
Oct 30 02:55:44.285615 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285586    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23e7ce26-ee23-41a7-a925-6fa7c29eda06-config\") pod \"console-operator-7cd56b8dbc-glqfz\" (UID: \"23e7ce26-ee23-41a7-a925-6fa7c29eda06\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:44.285615 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285608    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-hostroot\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.285796 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285624    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-conf-dir\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.285796 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285719    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-ca-trust-extracted\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:44.285796 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285743    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9qsl\" (UniqueName: \"kubernetes.io/projected/deae1b40-455b-40fd-af9a-c9dfa727a018-kube-api-access-t9qsl\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:44.285796 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285760    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23e7ce26-ee23-41a7-a925-6fa7c29eda06-config\") pod \"console-operator-7cd56b8dbc-glqfz\" (UID: \"23e7ce26-ee23-41a7-a925-6fa7c29eda06\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:44.285796 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285775    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-trusted-ca-bundle\") pod \"periodic-gathering-bf2qb-x5rb9\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") " pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:44.286005 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285824    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-ca-trust-extracted\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:44.286005 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285851    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb76r\" (UniqueName: \"kubernetes.io/projected/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-kube-api-access-jb76r\") pod \"periodic-gathering-bf2qb-x5rb9\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") " pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:44.286005 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285888    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ed3e2e45-04fe-4fe8-8e88-39439772c950-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz\" (UID: \"ed3e2e45-04fe-4fe8-8e88-39439772c950\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz"
Oct 30 02:55:44.286005 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285944    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-cnibin\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.286005 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.285962    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-run-k8s-cni-cncf-io\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.286192 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286013    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-daemon-config\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.286192 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286060    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-registration-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:44.286192 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286090    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-trusted-ca-bundle\") pod \"periodic-gathering-bf2qb-x5rb9\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") " pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:44.286192 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286096    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k98hn\" (UniqueName: \"kubernetes.io/projected/45836983-c4ed-4083-886b-07e4c4264527-kube-api-access-k98hn\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:44.286192 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286122    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23e7ce26-ee23-41a7-a925-6fa7c29eda06-serving-cert\") pod \"console-operator-7cd56b8dbc-glqfz\" (UID: \"23e7ce26-ee23-41a7-a925-6fa7c29eda06\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:44.286192 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286181    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-daemon-config\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.286192 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286188    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9frht\" (UniqueName: \"kubernetes.io/projected/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2-kube-api-access-9frht\") pod \"node-ca-s8pxs\" (UID: \"dec5346e-cd73-40b5-bcf4-05bc1a7e33e2\") " pod="openshift-image-registry/node-ca-s8pxs"
Oct 30 02:55:44.286519 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286282    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4aa93acd-52e0-4abe-ab94-12c4b3105126-ovnkube-script-lib\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.286519 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286353    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23e7ce26-ee23-41a7-a925-6fa7c29eda06-serving-cert\") pod \"console-operator-7cd56b8dbc-glqfz\" (UID: \"23e7ce26-ee23-41a7-a925-6fa7c29eda06\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:44.286519 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286450    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jkkwx\" (UID: \"744bf9e1-3e8b-402c-863a-331a6786f85c\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"
Oct 30 02:55:44.286519 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286496    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4aa93acd-52e0-4abe-ab94-12c4b3105126-ovnkube-script-lib\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.286519 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286490    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br65p\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-kube-api-access-br65p\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:44.286675 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286560    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/67e06851-bb40-4be7-87dd-36b84f182f8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:44.286675 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286583    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-kubelet\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.286994 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286727    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-sys-fs\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:44.286994 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286751    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/67e06851-bb40-4be7-87dd-36b84f182f8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:44.286994 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286758    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-certificates\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:44.286994 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286789    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8c9g\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-kube-api-access-t8c9g\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:44.286994 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286829    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/207f380c-c390-48c7-8df5-2d828b166284-etc-tuned\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.286994 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286851    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94wx2\" (UniqueName: \"kubernetes.io/projected/f71c9dd2-5916-4cd5-9aea-6fd70a343419-kube-api-access-94wx2\") pod \"kas-connection-checker-685895c7c9-dtw44\" (UID: \"f71c9dd2-5916-4cd5-9aea-6fd70a343419\") " pod="kube-system/kas-connection-checker-685895c7c9-dtw44"
Oct 30 02:55:44.286994 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286873    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-certificates\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:44.286994 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286903    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-certificates\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:44.286994 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286899    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.286994 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286920    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/207f380c-c390-48c7-8df5-2d828b166284-etc-tuned\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.286994 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286944    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-socket-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:44.286994 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.286971    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-archives-path\") pod \"periodic-gathering-bf2qb-x5rb9\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") " pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:44.287477 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287003    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9nkd\" (UniqueName: \"kubernetes.io/projected/4f3b466e-4894-448e-bc16-a106de5cb14d-kube-api-access-j9nkd\") pod \"cluster-samples-operator-6ddb6c8b94-zw522\" (UID: \"4f3b466e-4894-448e-bc16-a106de5cb14d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:44.287477 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287028    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2pmx\" (UniqueName: \"kubernetes.io/projected/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887-kube-api-access-q2pmx\") pod \"iptables-alerter-twcgj\" (UID: \"bd1c3b69-f5f0-415e-a4a1-2be07d7d1887\") " pod="openshift-network-operator/iptables-alerter-twcgj"
Oct 30 02:55:44.287477 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287064    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-archives-path\") pod \"periodic-gathering-bf2qb-x5rb9\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") " pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:44.287477 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287068    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w79xq\" (UniqueName: \"kubernetes.io/projected/16ef1049-ff3e-486a-b565-06aa545c8592-kube-api-access-w79xq\") pod \"service-ca-5fffc97bdf-2xft4\" (UID: \"16ef1049-ff3e-486a-b565-06aa545c8592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-2xft4"
Oct 30 02:55:44.287477 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287071    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-certificates\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:44.287477 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287101    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgxnj\" (UniqueName: \"kubernetes.io/projected/207f380c-c390-48c7-8df5-2d828b166284-kube-api-access-xgxnj\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.287477 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287125    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-log-socket\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.287477 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287162    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-kubelet-config\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:44.287477 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287188    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/45836983-c4ed-4083-886b-07e4c4264527-config-volume\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:44.287477 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287226    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0155b708-711a-4794-9fd5-bd88e9cae690-serving-cert\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:44.287477 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287291    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-installation-pull-secrets\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:44.287477 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287365    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/45836983-c4ed-4083-886b-07e4c4264527-config-volume\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:44.287477 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287369    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0155b708-711a-4794-9fd5-bd88e9cae690-serving-cert\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:44.287477 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287404    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/322fa146-852c-4aca-a334-e9ba4e23d8ad-hosts-file\") pod \"node-resolver-ttjnv\" (UID: \"322fa146-852c-4aca-a334-e9ba4e23d8ad\") " pod="openshift-dns/node-resolver-ttjnv"
Oct 30 02:55:44.287477 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287460    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-image-registry-private-configuration\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:44.288079 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287485    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-trusted-ca\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:44.288079 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287502    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-installation-pull-secrets\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:44.288079 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287543    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g2pl\" (UniqueName: \"kubernetes.io/projected/0155b708-711a-4794-9fd5-bd88e9cae690-kube-api-access-8g2pl\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:44.288079 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287607    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-image-registry-private-configuration\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:44.288079 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287630    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpfxh\" (UniqueName: \"kubernetes.io/projected/67e06851-bb40-4be7-87dd-36b84f182f8c-kube-api-access-cpfxh\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:44.288079 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287667    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3bbb4629-dd25-4dae-b2a0-be0099cacaeb-konnectivity-ca\") pod \"konnectivity-agent-7jm4j\" (UID: \"3bbb4629-dd25-4dae-b2a0-be0099cacaeb\") " pod="kube-system/konnectivity-agent-7jm4j"
Oct 30 02:55:44.288079 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287709    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-sysctl-d\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.288079 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287782    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-trusted-ca\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:44.288079 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.287868    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3bbb4629-dd25-4dae-b2a0-be0099cacaeb-konnectivity-ca\") pod \"konnectivity-agent-7jm4j\" (UID: \"3bbb4629-dd25-4dae-b2a0-be0099cacaeb\") " pod="kube-system/konnectivity-agent-7jm4j"
Oct 30 02:55:44.301212 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.301189    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znv57\" (UniqueName: \"kubernetes.io/projected/008e880d-1e3d-4290-b25f-442ee1d90975-kube-api-access-znv57\") pod \"kas-connection-checker-685895c7c9-fvrpn\" (UID: \"008e880d-1e3d-4290-b25f-442ee1d90975\") " pod="kube-system/kas-connection-checker-685895c7c9-fvrpn"
Oct 30 02:55:44.301802 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.301784    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhjmb\" (UniqueName: \"kubernetes.io/projected/ba0ccc16-d085-4d7f-8df5-e9194ba06f33-kube-api-access-dhjmb\") pod \"migrator-66df5d496b-ql7f5\" (UID: \"ba0ccc16-d085-4d7f-8df5-e9194ba06f33\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-ql7f5"
Oct 30 02:55:44.301918 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.301903    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncgfc\" (UniqueName: \"kubernetes.io/projected/d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0-kube-api-access-ncgfc\") pod \"service-ca-operator-544d749c8c-7j4nj\" (UID: \"d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj"
Oct 30 02:55:44.302201 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.302185    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g92lj\" (UniqueName: \"kubernetes.io/projected/05bcf726-e398-4201-b974-52406fbdc287-kube-api-access-g92lj\") pod \"cluster-monitoring-operator-884576c57-9d2rd\" (UID: \"05bcf726-e398-4201-b974-52406fbdc287\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:44.302852 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.302835    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk75k\" (UniqueName: \"kubernetes.io/projected/a707ea73-de7e-406f-89ec-9197a6c0f2b5-kube-api-access-xk75k\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:44.303403 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.303387    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-bound-sa-token\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:44.304421 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.304401    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmgxl\" (UniqueName: \"kubernetes.io/projected/e7a138e6-2485-4134-9d3a-c2419d154f30-kube-api-access-wmgxl\") pod \"network-metrics-daemon-zxzxk\" (UID: \"e7a138e6-2485-4134-9d3a-c2419d154f30\") " pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:44.305377 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.305361    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzd97\" (UniqueName: \"kubernetes.io/projected/51b2e157-f1a2-4630-aab9-9ddcd71d5bca-kube-api-access-kzd97\") pod \"kas-connection-checker-685895c7c9-sppcg\" (UID: \"51b2e157-f1a2-4630-aab9-9ddcd71d5bca\") " pod="kube-system/kas-connection-checker-685895c7c9-sppcg"
Oct 30 02:55:44.305806 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.305788    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnvfv\" (UniqueName: \"kubernetes.io/projected/7d4449be-5ad9-45a2-a708-8935ea16fed1-kube-api-access-pnvfv\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.318794 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.318774    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlm47\" (UniqueName: \"kubernetes.io/projected/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-api-access-mlm47\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:44.322763 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.322743    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs8gw\" (UniqueName: \"kubernetes.io/projected/4aa93acd-52e0-4abe-ab94-12c4b3105126-kube-api-access-zs8gw\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.325298 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.325281    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4hvv\" (UniqueName: \"kubernetes.io/projected/6aa78c16-a2a2-4a61-adb7-575224b8ac6f-kube-api-access-c4hvv\") pod \"volume-data-source-validator-58c9f5f46d-cxwq4\" (UID: \"6aa78c16-a2a2-4a61-adb7-575224b8ac6f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-cxwq4"
Oct 30 02:55:44.325933 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.325918    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-bound-sa-token\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:44.327041 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.327023    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7p4v\" (UniqueName: \"kubernetes.io/projected/26009c26-16bc-4e82-8246-ebf75fa644e9-kube-api-access-n7p4v\") pod \"ingress-canary-xqnbh\" (UID: \"26009c26-16bc-4e82-8246-ebf75fa644e9\") " pod="openshift-ingress-canary/ingress-canary-xqnbh"
Oct 30 02:55:44.331089 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.331072    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww2rj\" (UniqueName: \"kubernetes.io/projected/ed43211b-ec42-4683-99a6-541bf0a09c7e-kube-api-access-ww2rj\") pod \"migrator-66df5d496b-rrzgh\" (UID: \"ed43211b-ec42-4683-99a6-541bf0a09c7e\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-rrzgh"
Oct 30 02:55:44.331217 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.331200    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k98hn\" (UniqueName: \"kubernetes.io/projected/45836983-c4ed-4083-886b-07e4c4264527-kube-api-access-k98hn\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:44.331565 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.331551    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9frht\" (UniqueName: \"kubernetes.io/projected/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2-kube-api-access-9frht\") pod \"node-ca-s8pxs\" (UID: \"dec5346e-cd73-40b5-bcf4-05bc1a7e33e2\") " pod="openshift-image-registry/node-ca-s8pxs"
Oct 30 02:55:44.332315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.332297    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4mxx\" (UniqueName: \"kubernetes.io/projected/322fa146-852c-4aca-a334-e9ba4e23d8ad-kube-api-access-m4mxx\") pod \"node-resolver-ttjnv\" (UID: \"322fa146-852c-4aca-a334-e9ba4e23d8ad\") " pod="openshift-dns/node-resolver-ttjnv"
Oct 30 02:55:44.332991 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.332974    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9nkd\" (UniqueName: \"kubernetes.io/projected/4f3b466e-4894-448e-bc16-a106de5cb14d-kube-api-access-j9nkd\") pod \"cluster-samples-operator-6ddb6c8b94-zw522\" (UID: \"4f3b466e-4894-448e-bc16-a106de5cb14d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:44.333506 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.333487    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drz2l\" (UniqueName: \"kubernetes.io/projected/46ab1416-b4cf-4b29-b8b3-38fdf77db001-kube-api-access-drz2l\") pod \"network-check-target-p7mkl\" (UID: \"46ab1416-b4cf-4b29-b8b3-38fdf77db001\") " pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:44.333581 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.333512    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpfxh\" (UniqueName: \"kubernetes.io/projected/67e06851-bb40-4be7-87dd-36b84f182f8c-kube-api-access-cpfxh\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:44.334958 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.334939    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sq96\" (UniqueName: \"kubernetes.io/projected/7eb43cf3-056c-4372-94b6-dc57ed47dd83-kube-api-access-7sq96\") pod \"network-check-source-6f78d59f99-v5ppj\" (UID: \"7eb43cf3-056c-4372-94b6-dc57ed47dd83\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-v5ppj"
Oct 30 02:55:44.336810 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.336794    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9qsl\" (UniqueName: \"kubernetes.io/projected/deae1b40-455b-40fd-af9a-c9dfa727a018-kube-api-access-t9qsl\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:44.336981 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.336966    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br65p\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-kube-api-access-br65p\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:44.338031 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.338014    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgxnj\" (UniqueName: \"kubernetes.io/projected/207f380c-c390-48c7-8df5-2d828b166284-kube-api-access-xgxnj\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.338089 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.338047    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w79xq\" (UniqueName: \"kubernetes.io/projected/16ef1049-ff3e-486a-b565-06aa545c8592-kube-api-access-w79xq\") pod \"service-ca-5fffc97bdf-2xft4\" (UID: \"16ef1049-ff3e-486a-b565-06aa545c8592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-2xft4"
Oct 30 02:55:44.338800 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.338781    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbqgb\" (UniqueName: \"kubernetes.io/projected/ed3e2e45-04fe-4fe8-8e88-39439772c950-kube-api-access-lbqgb\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz\" (UID: \"ed3e2e45-04fe-4fe8-8e88-39439772c950\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz"
Oct 30 02:55:44.339980 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.339955    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nzs8\" (UniqueName: \"kubernetes.io/projected/23e7ce26-ee23-41a7-a925-6fa7c29eda06-kube-api-access-8nzs8\") pod \"console-operator-7cd56b8dbc-glqfz\" (UID: \"23e7ce26-ee23-41a7-a925-6fa7c29eda06\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:44.340264 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.340247    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94wx2\" (UniqueName: \"kubernetes.io/projected/f71c9dd2-5916-4cd5-9aea-6fd70a343419-kube-api-access-94wx2\") pod \"kas-connection-checker-685895c7c9-dtw44\" (UID: \"f71c9dd2-5916-4cd5-9aea-6fd70a343419\") " pod="kube-system/kas-connection-checker-685895c7c9-dtw44"
Oct 30 02:55:44.341504 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.341487    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8c9g\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-kube-api-access-t8c9g\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:44.342719 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.342681    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2pmx\" (UniqueName: \"kubernetes.io/projected/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887-kube-api-access-q2pmx\") pod \"iptables-alerter-twcgj\" (UID: \"bd1c3b69-f5f0-415e-a4a1-2be07d7d1887\") " pod="openshift-network-operator/iptables-alerter-twcgj"
Oct 30 02:55:44.342865 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.342847    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g2pl\" (UniqueName: \"kubernetes.io/projected/0155b708-711a-4794-9fd5-bd88e9cae690-kube-api-access-8g2pl\") pod \"insights-operator-7c4986d449-kss29\" (UID: \"0155b708-711a-4794-9fd5-bd88e9cae690\") " pod="openshift-insights/insights-operator-7c4986d449-kss29"
Oct 30 02:55:44.343162 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.343144    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb76r\" (UniqueName: \"kubernetes.io/projected/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-kube-api-access-jb76r\") pod \"periodic-gathering-bf2qb-x5rb9\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") " pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:55:44.388495 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388469    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-sysctl-d\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.388581 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388502    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-systemd-units\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.388581 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388525    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-run-openvswitch\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.388581 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388550    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-kubernetes\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.388759 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388582    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-sysctl-d\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.388759 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388603    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-run-openvswitch\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.388759 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388610    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-kubernetes\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.388759 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388620    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-metrics-certs\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:44.388759 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388604    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-systemd-units\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.388759 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388649    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-var-lib-cni-bin\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.388759 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388666    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-var-lib-kubelet\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.388759 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388704    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-var-lib-cni-bin\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.388759 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388706    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-socket-dir-parent\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.388759 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388733    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-run-multus-certs\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.388759 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388752    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-var-lib-kubelet\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.388759 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388760    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388776    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-socket-dir-parent\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388786    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388796    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-run-multus-certs\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388808    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-etc-kubernetes\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388825    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-crio-socket\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388843    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-lib-modules\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388844    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388883    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-etc-kubernetes\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388908    5068 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.388924    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle podName:deae1b40-455b-40fd-af9a-c9dfa727a018 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:44.888902502 +0000 UTC m=+1.964272708 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle") pod "router-default-67f9ffd857-gnqzw" (UID: "deae1b40-455b-40fd-af9a-c9dfa727a018") : configmap references non-existent config key: service-ca.crt
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388924    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-crio-socket\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388963    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-cni-bin\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.388995    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389005    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-lib-modules\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389020    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-sysconfig\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389037    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-cni-bin\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389047    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-slash\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389081    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-modprobe-d\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.389095    5068 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389116    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-systemd\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389083    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-slash\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389142    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-run-systemd\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.389168    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls podName:b1eeaa36-b8dc-4f8a-81f4-54b22848135d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:44.889157351 +0000 UTC m=+1.964527554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9jzff" (UID: "b1eeaa36-b8dc-4f8a-81f4-54b22848135d") : secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389168    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-modprobe-d\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389115    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-sysconfig\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389193    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-systemd\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389187    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-run-ovn-kubernetes\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389214    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-run-systemd\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389236    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-device-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389254    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/05bcf726-e398-4201-b974-52406fbdc287-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-9d2rd\" (UID: \"05bcf726-e398-4201-b974-52406fbdc287\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389283    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-run-ovn-kubernetes\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389290    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-etc-selinux\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389306    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-device-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389316    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-system-cni-dir\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.389315 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389323    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-etc-selinux\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389349    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-var-lib-kubelet\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389375    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67e06851-bb40-4be7-87dd-36b84f182f8c-system-cni-dir\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389397    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-host\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389376    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-system-cni-dir\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389407    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-var-lib-kubelet\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389423    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-var-lib-openvswitch\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389447    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-host\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389444    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67e06851-bb40-4be7-87dd-36b84f182f8c-system-cni-dir\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389458    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-run-ovn\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389461    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-var-lib-openvswitch\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389485    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389486    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-run-ovn\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389509    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-dbus\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389555    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-dbus\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389565    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67e06851-bb40-4be7-87dd-36b84f182f8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389584    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2-host\") pod \"node-ca-s8pxs\" (UID: \"dec5346e-cd73-40b5-bcf4-05bc1a7e33e2\") " pod="openshift-image-registry/node-ca-s8pxs"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389599    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887-host-slash\") pod \"iptables-alerter-twcgj\" (UID: \"bd1c3b69-f5f0-415e-a4a1-2be07d7d1887\") " pod="openshift-network-operator/iptables-alerter-twcgj"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389631    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs\") pod \"network-metrics-daemon-zxzxk\" (UID: \"e7a138e6-2485-4134-9d3a-c2419d154f30\") " pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389638    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd1c3b69-f5f0-415e-a4a1-2be07d7d1887-host-slash\") pod \"iptables-alerter-twcgj\" (UID: \"bd1c3b69-f5f0-415e-a4a1-2be07d7d1887\") " pod="openshift-network-operator/iptables-alerter-twcgj"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389606    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67e06851-bb40-4be7-87dd-36b84f182f8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389650    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dec5346e-cd73-40b5-bcf4-05bc1a7e33e2-host\") pod \"node-ca-s8pxs\" (UID: \"dec5346e-cd73-40b5-bcf4-05bc1a7e33e2\") " pod="openshift-image-registry/node-ca-s8pxs"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389651    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-sys\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389711    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-run-netns\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389735    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-run-netns\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.389744    5068 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389759    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-var-lib-cni-multus\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389778    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-run-netns\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389785    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389743    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-sys\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.389800    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs podName:e7a138e6-2485-4134-9d3a-c2419d154f30 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:44.88978372 +0000 UTC m=+1.965153914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs") pod "network-metrics-daemon-zxzxk" (UID: "e7a138e6-2485-4134-9d3a-c2419d154f30") : secret "metrics-daemon-secret" not found
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389819    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-run-netns\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389830    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-var-lib-cni-multus\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389836    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.389878    5068 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.389894    5068 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.389906    5068 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88cb97fb-qnc8x: secret "image-registry-tls" not found
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389911    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67e06851-bb40-4be7-87dd-36b84f182f8c-cnibin\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389881    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67e06851-bb40-4be7-87dd-36b84f182f8c-cnibin\") pod \"multus-additional-cni-plugins-r6frn\" (UID: \"67e06851-bb40-4be7-87dd-36b84f182f8c\") " pod="openshift-multus/multus-additional-cni-plugins-r6frn"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389950    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-etc-openvswitch\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.389893    5068 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b8cd6f65-mwg8n: secret "image-registry-tls" not found
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.389977    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-etc-openvswitch\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.389961    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls podName:80f1930a-aa7c-46a0-9a4c-95f35539bf4c nodeName:}" failed. No retries permitted until 2026-10-30 02:55:44.889949005 +0000 UTC m=+1.965319209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls") pod "image-registry-88cb97fb-qnc8x" (UID: "80f1930a-aa7c-46a0-9a4c-95f35539bf4c") : secret "image-registry-tls" not found
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390001    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.390039    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls podName:8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:44.890022389 +0000 UTC m=+1.965392578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls") pod "image-registry-57b8cd6f65-mwg8n" (UID: "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d") : secret "image-registry-tls" not found
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390058    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-node-log\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390084    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-zw522\" (UID: \"4f3b466e-4894-448e-bc16-a106de5cb14d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390114    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-run\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390139    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-cni-dir\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390150    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-node-log\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390166    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390188    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-run\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390191    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-sysctl-conf\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390213    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-cni-dir\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.390279    5068 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390309    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/207f380c-c390-48c7-8df5-2d828b166284-etc-sysctl-conf\") pod \"tuned-w29gr\" (UID: \"207f380c-c390-48c7-8df5-2d828b166284\") " pod="openshift-cluster-node-tuning-operator/tuned-w29gr"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.390321    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls podName:45836983-c4ed-4083-886b-07e4c4264527 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:44.890308085 +0000 UTC m=+1.965678275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls") pod "dns-default-ftq8q" (UID: "45836983-c4ed-4083-886b-07e4c4264527") : secret "dns-default-metrics-tls" not found
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390340    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-cni-netd\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390367    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-hostroot\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390407    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-hostroot\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390417    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-cni-netd\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390436    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-conf-dir\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390465    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-cnibin\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390478    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-multus-conf-dir\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390490    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-run-k8s-cni-cncf-io\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390517    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-registration-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390533    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-cnibin\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390546    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jkkwx\" (UID: \"744bf9e1-3e8b-402c-863a-331a6786f85c\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390570    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d4449be-5ad9-45a2-a708-8935ea16fed1-host-run-k8s-cni-cncf-io\") pod \"multus-cvsmc\" (UID: \"7d4449be-5ad9-45a2-a708-8935ea16fed1\") " pod="openshift-multus/multus-cvsmc"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390603    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-registration-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.390623    5068 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390637    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-kubelet\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.390663    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert podName:744bf9e1-3e8b-402c-863a-331a6786f85c nodeName:}" failed. No retries permitted until 2026-10-30 02:55:44.890650266 +0000 UTC m=+1.966020474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-jkkwx" (UID: "744bf9e1-3e8b-402c-863a-331a6786f85c") : secret "networking-console-plugin-cert" not found
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390679    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-sys-fs\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390702    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-kubelet\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390728    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390754    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-socket-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390755    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-sys-fs\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390784    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-log-socket\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390809    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-kubelet-config\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390817    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-log-socket\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390784    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa93acd-52e0-4abe-ab94-12c4b3105126-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rpbtg\" (UID: \"4aa93acd-52e0-4abe-ab94-12c4b3105126\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390830    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a707ea73-de7e-406f-89ec-9197a6c0f2b5-socket-dir\") pod \"aws-ebs-csi-driver-node-7dcg5\" (UID: \"a707ea73-de7e-406f-89ec-9197a6c0f2b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dcg5"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390836    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/322fa146-852c-4aca-a334-e9ba4e23d8ad-hosts-file\") pod \"node-resolver-ttjnv\" (UID: \"322fa146-852c-4aca-a334-e9ba4e23d8ad\") " pod="openshift-dns/node-resolver-ttjnv"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390876    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc-kubelet-config\") pod \"global-pull-secret-syncer-lg4vm\" (UID: \"f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc\") " pod="kube-system/global-pull-secret-syncer-lg4vm"
Oct 30 02:55:44.390993 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.390910    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/322fa146-852c-4aca-a334-e9ba4e23d8ad-hosts-file\") pod \"node-resolver-ttjnv\" (UID: \"322fa146-852c-4aca-a334-e9ba4e23d8ad\") " pod="openshift-dns/node-resolver-ttjnv"
Oct 30 02:55:44.393399 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.391487    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deae1b40-455b-40fd-af9a-c9dfa727a018-metrics-certs\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:44.393399 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.391817    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/05bcf726-e398-4201-b974-52406fbdc287-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-9d2rd\" (UID: \"05bcf726-e398-4201-b974-52406fbdc287\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:44.393399 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.392457    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f3b466e-4894-448e-bc16-a106de5cb14d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-zw522\" (UID: \"4f3b466e-4894-448e-bc16-a106de5cb14d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:44.437447 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.437424    5068 scope.go:122] "RemoveContainer" containerID="40feda09fb99d9862f6d8156d3ed4f38964693e1f22005c2ea9663219677ee9f"
Oct 30 02:55:44.437733 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.437715    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"
Oct 30 02:55:44.438500 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.438485    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"
Oct 30 02:55:44.653350 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.653311    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:44.763171 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.763142    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd"]
Oct 30 02:55:44.768572 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:44.768541    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05bcf726_e398_4201_b974_52406fbdc287.slice/crio-5c070ebe50b596300f6375df69bf9fe0fdf754a91199eda8eb94540870a1d457 WatchSource:0}: Error finding container 5c070ebe50b596300f6375df69bf9fe0fdf754a91199eda8eb94540870a1d457: Status 404 returned error can't find the container with id 5c070ebe50b596300f6375df69bf9fe0fdf754a91199eda8eb94540870a1d457
Oct 30 02:55:44.770679 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.770659    5068 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 02:55:44.809803 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.809774    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522"]
Oct 30 02:55:44.851353 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.851322    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:44.895594 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.895575    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:44.895702 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.895606    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:44.895702 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.895638    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs\") pod \"network-metrics-daemon-zxzxk\" (UID: \"e7a138e6-2485-4134-9d3a-c2419d154f30\") " pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:44.895702 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.895660    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:44.895702 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.895676    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:44.895851 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.895728    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:44.895851 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.895751    5068 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:44.895851 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.895768    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle podName:deae1b40-455b-40fd-af9a-c9dfa727a018 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:45.895747429 +0000 UTC m=+2.971117625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle") pod "router-default-67f9ffd857-gnqzw" (UID: "deae1b40-455b-40fd-af9a-c9dfa727a018") : configmap references non-existent config key: service-ca.crt
Oct 30 02:55:44.895851 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.895797    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls podName:b1eeaa36-b8dc-4f8a-81f4-54b22848135d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:45.895786138 +0000 UTC m=+2.971156342 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9jzff" (UID: "b1eeaa36-b8dc-4f8a-81f4-54b22848135d") : secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:44.895851 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.895802    5068 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 02:55:44.895851 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:44.895817    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jkkwx\" (UID: \"744bf9e1-3e8b-402c-863a-331a6786f85c\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"
Oct 30 02:55:44.895851 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.895830    5068 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:44.895851 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.895842    5068 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88cb97fb-qnc8x: secret "image-registry-tls" not found
Oct 30 02:55:44.895851 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.895855    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs podName:e7a138e6-2485-4134-9d3a-c2419d154f30 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:45.895841431 +0000 UTC m=+2.971211625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs") pod "network-metrics-daemon-zxzxk" (UID: "e7a138e6-2485-4134-9d3a-c2419d154f30") : secret "metrics-daemon-secret" not found
Oct 30 02:55:44.896130 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.895806    5068 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:44.896130 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.895874    5068 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b8cd6f65-mwg8n: secret "image-registry-tls" not found
Oct 30 02:55:44.896130 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.895879    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls podName:80f1930a-aa7c-46a0-9a4c-95f35539bf4c nodeName:}" failed. No retries permitted until 2026-10-30 02:55:45.895866271 +0000 UTC m=+2.971236482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls") pod "image-registry-88cb97fb-qnc8x" (UID: "80f1930a-aa7c-46a0-9a4c-95f35539bf4c") : secret "image-registry-tls" not found
Oct 30 02:55:44.896130 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.895902    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls podName:8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:45.895893988 +0000 UTC m=+2.971264177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls") pod "image-registry-57b8cd6f65-mwg8n" (UID: "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d") : secret "image-registry-tls" not found
Oct 30 02:55:44.896130 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.895807    5068 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 02:55:44.896130 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.895913    5068 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 02:55:44.896130 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.895927    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls podName:45836983-c4ed-4083-886b-07e4c4264527 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:45.895921992 +0000 UTC m=+2.971292182 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls") pod "dns-default-ftq8q" (UID: "45836983-c4ed-4083-886b-07e4c4264527") : secret "dns-default-metrics-tls" not found
Oct 30 02:55:44.896130 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:44.895946    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert podName:744bf9e1-3e8b-402c-863a-331a6786f85c nodeName:}" failed. No retries permitted until 2026-10-30 02:55:45.895936011 +0000 UTC m=+2.971306230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-jkkwx" (UID: "744bf9e1-3e8b-402c-863a-331a6786f85c") : secret "networking-console-plugin-cert" not found
Oct 30 02:55:45.105240 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:45.105156    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:45.138342 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:45.138316    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/1.log"
Oct 30 02:55:45.138494 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:45.138417    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz" event={"ID":"23e7ce26-ee23-41a7-a925-6fa7c29eda06","Type":"ContainerStarted","Data":"d7642754d3df21a09d34c4e07fa1190c2ee45392e23e11c7fb8dbc8e583ddb1c"}
Oct 30 02:55:45.139610 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:45.139581    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522" event={"ID":"4f3b466e-4894-448e-bc16-a106de5cb14d","Type":"ContainerStarted","Data":"af3ea438b3ea9ab70aca0faaff13493d7e550ac7de6d90e71d49a477a55baccb"}
Oct 30 02:55:45.140826 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:45.140803    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd" event={"ID":"05bcf726-e398-4201-b974-52406fbdc287","Type":"ContainerStarted","Data":"5c070ebe50b596300f6375df69bf9fe0fdf754a91199eda8eb94540870a1d457"}
Oct 30 02:55:45.360855 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:45.360775    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:45.542437 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:45.542400    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:45.742392 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:45.742359    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:45.911057 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:45.911020    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:45.911057 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:45.911060    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:45.911304 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:45.911097    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:45.911304 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:45.911127    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jkkwx\" (UID: \"744bf9e1-3e8b-402c-863a-331a6786f85c\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"
Oct 30 02:55:45.911304 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:45.911167    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:45.911304 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:45.911185    5068 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:45.911304 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:45.911205    5068 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b8cd6f65-mwg8n: secret "image-registry-tls" not found
Oct 30 02:55:45.911304 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:45.911259    5068 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:45.911304 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:45.911270    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls podName:8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:47.911250022 +0000 UTC m=+4.986620225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls") pod "image-registry-57b8cd6f65-mwg8n" (UID: "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d") : secret "image-registry-tls" not found
Oct 30 02:55:45.911304 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:45.911297    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls podName:b1eeaa36-b8dc-4f8a-81f4-54b22848135d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:47.911287253 +0000 UTC m=+4.986657473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9jzff" (UID: "b1eeaa36-b8dc-4f8a-81f4-54b22848135d") : secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:45.911738 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:45.911338    5068 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:45.911738 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:45.911345    5068 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88cb97fb-qnc8x: secret "image-registry-tls" not found
Oct 30 02:55:45.911738 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:45.911366    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls podName:80f1930a-aa7c-46a0-9a4c-95f35539bf4c nodeName:}" failed. No retries permitted until 2026-10-30 02:55:47.911358891 +0000 UTC m=+4.986729110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls") pod "image-registry-88cb97fb-qnc8x" (UID: "80f1930a-aa7c-46a0-9a4c-95f35539bf4c") : secret "image-registry-tls" not found
Oct 30 02:55:45.911738 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:45.911405    5068 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 02:55:45.911738 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:45.911427    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls podName:45836983-c4ed-4083-886b-07e4c4264527 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:47.911419171 +0000 UTC m=+4.986789391 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls") pod "dns-default-ftq8q" (UID: "45836983-c4ed-4083-886b-07e4c4264527") : secret "dns-default-metrics-tls" not found
Oct 30 02:55:45.911738 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:45.911466    5068 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 02:55:45.911738 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:45.911485    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert podName:744bf9e1-3e8b-402c-863a-331a6786f85c nodeName:}" failed. No retries permitted until 2026-10-30 02:55:47.911479312 +0000 UTC m=+4.986849535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-jkkwx" (UID: "744bf9e1-3e8b-402c-863a-331a6786f85c") : secret "networking-console-plugin-cert" not found
Oct 30 02:55:45.911738 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:45.911187    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:45.911738 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:45.911531    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle podName:deae1b40-455b-40fd-af9a-c9dfa727a018 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:47.911525158 +0000 UTC m=+4.986895384 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle") pod "router-default-67f9ffd857-gnqzw" (UID: "deae1b40-455b-40fd-af9a-c9dfa727a018") : configmap references non-existent config key: service-ca.crt
Oct 30 02:55:45.911738 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:45.911580    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs\") pod \"network-metrics-daemon-zxzxk\" (UID: \"e7a138e6-2485-4134-9d3a-c2419d154f30\") " pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:45.911738 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:45.911659    5068 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 02:55:45.911738 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:45.911699    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs podName:e7a138e6-2485-4134-9d3a-c2419d154f30 nodeName:}" failed. No retries permitted until 2026-10-30 02:55:47.911678257 +0000 UTC m=+4.987048447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs") pod "network-metrics-daemon-zxzxk" (UID: "e7a138e6-2485-4134-9d3a-c2419d154f30") : secret "metrics-daemon-secret" not found
Oct 30 02:55:46.667970 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:46.667937    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:46.872807 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:46.872764    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:47.082405 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:47.082372    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:47.150909 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:47.150823    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-9d2rd" event={"ID":"05bcf726-e398-4201-b974-52406fbdc287","Type":"ContainerStarted","Data":"2575539ab29d3216d9ce6f81e54b72f5535e62ee04bf03f361bf4943a6466249"}
Oct 30 02:55:47.152828 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:47.152799    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522" event={"ID":"4f3b466e-4894-448e-bc16-a106de5cb14d","Type":"ContainerStarted","Data":"baeeba1b15515f45469154b4a70891d26c435b16a37af8711242898ecdc6278d"}
Oct 30 02:55:47.152934 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:47.152845    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zw522" event={"ID":"4f3b466e-4894-448e-bc16-a106de5cb14d","Type":"ContainerStarted","Data":"409edcd7ff5dccf9cf5c7b7a4a059ff8fd4d8b06ac886e90d2e1abca579a5c56"}
Oct 30 02:55:47.306275 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:47.306246    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:47.479426 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:47.479353    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:47.618586 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:47.618560    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:55:47.757220 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:47.757154    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:47.937868 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:47.937840    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:47.938022 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:47.937876    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:47.938022 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:47.937914    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs\") pod \"network-metrics-daemon-zxzxk\" (UID: \"e7a138e6-2485-4134-9d3a-c2419d154f30\") " pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:47.938022 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:47.937936    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:47.938022 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:47.937952    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:47.938022 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:47.937974    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:47.938022 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:47.937998    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jkkwx\" (UID: \"744bf9e1-3e8b-402c-863a-331a6786f85c\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"
Oct 30 02:55:47.938309 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:47.938072    5068 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:47.938309 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:47.938083    5068 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:47.938309 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:47.938094    5068 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88cb97fb-qnc8x: secret "image-registry-tls" not found
Oct 30 02:55:47.938309 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:47.938090    5068 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 02:55:47.938309 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:47.938135    5068 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b8cd6f65-mwg8n: secret "image-registry-tls" not found
Oct 30 02:55:47.938309 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:47.938155    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls podName:b1eeaa36-b8dc-4f8a-81f4-54b22848135d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:51.938134779 +0000 UTC m=+9.013504973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9jzff" (UID: "b1eeaa36-b8dc-4f8a-81f4-54b22848135d") : secret "insights-runtime-extractor-tls" not found
Oct 30 02:55:47.938309 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:47.938177    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls podName:8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d nodeName:}" failed. No retries permitted until 2026-10-30 02:55:51.938166243 +0000 UTC m=+9.013536439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls") pod "image-registry-57b8cd6f65-mwg8n" (UID: "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d") : secret "image-registry-tls" not found
Oct 30 02:55:47.938309 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:55:47.938194    5068 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls podName:80f1930a-aa7c-46a0-9a4c-95f35539bf4c nodeName:}" failed. No retries permitted until 2026-10-30 02:55:51.93818649 +0000 UTC m=+9.013556680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls") pod "image-registry-88cb97fb-qnc8x" (UID: "80f1930a-aa7c-46a0-9a4c-95f35539bf4c") : secret "image-registry-tls" not found
Oct 30 02:55:47.938665 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:47.938541    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deae1b40-455b-40fd-af9a-c9dfa727a018-service-ca-bundle\") pod \"router-default-67f9ffd857-gnqzw\" (UID: \"deae1b40-455b-40fd-af9a-c9dfa727a018\") " pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:47.940448 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:47.940425    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7a138e6-2485-4134-9d3a-c2419d154f30-metrics-certs\") pod \"network-metrics-daemon-zxzxk\" (UID: \"e7a138e6-2485-4134-9d3a-c2419d154f30\") " pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:47.940546 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:47.940486    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45836983-c4ed-4083-886b-07e4c4264527-metrics-tls\") pod \"dns-default-ftq8q\" (UID: \"45836983-c4ed-4083-886b-07e4c4264527\") " pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:47.940585 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:47.940551    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/744bf9e1-3e8b-402c-863a-331a6786f85c-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jkkwx\" (UID: \"744bf9e1-3e8b-402c-863a-331a6786f85c\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"
Oct 30 02:55:48.037422 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:48.037360    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:48.040017 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:48.039999    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"
Oct 30 02:55:48.043509 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:48.043491    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxzxk"
Oct 30 02:55:48.046745 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:48.046706    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:48.158695 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:48.158657    5068 generic.go:356] "Generic (PLEG): container finished" podID="ed3e2e45-04fe-4fe8-8e88-39439772c950" containerID="c268ff1a443001b61cb123310d2f2e22acbd2108942ffc7cc754255d5c448cd8" exitCode=0
Oct 30 02:55:48.158864 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:48.158834    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz" event={"ID":"ed3e2e45-04fe-4fe8-8e88-39439772c950","Type":"ContainerDied","Data":"c268ff1a443001b61cb123310d2f2e22acbd2108942ffc7cc754255d5c448cd8"}
Oct 30 02:55:48.159212 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:48.159194    5068 scope.go:122] "RemoveContainer" containerID="c268ff1a443001b61cb123310d2f2e22acbd2108942ffc7cc754255d5c448cd8"
Oct 30 02:55:48.162886 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:48.161830    5068 generic.go:356] "Generic (PLEG): container finished" podID="d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0" containerID="860393b61fd7c50de0085197dc82ea2f101b60f4dce6490cb946aa2024536587" exitCode=0
Oct 30 02:55:48.162886 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:48.161950    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj" event={"ID":"d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0","Type":"ContainerDied","Data":"860393b61fd7c50de0085197dc82ea2f101b60f4dce6490cb946aa2024536587"}
Oct 30 02:55:48.163180 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:48.162974    5068 scope.go:122] "RemoveContainer" containerID="860393b61fd7c50de0085197dc82ea2f101b60f4dce6490cb946aa2024536587"
Oct 30 02:55:48.366968 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:48.366899    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67f9ffd857-gnqzw"]
Oct 30 02:55:48.370011 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:48.369983    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zxzxk"]
Oct 30 02:55:48.370641 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:48.370619    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ftq8q"]
Oct 30 02:55:48.371225 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:48.371206    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-jkkwx"]
Oct 30 02:55:48.372322 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:48.372298    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeae1b40_455b_40fd_af9a_c9dfa727a018.slice/crio-fc8b36e75f1dcfc2167ab46615ba9dd815087ea2f6c22be2be5ccaf6030937ed WatchSource:0}: Error finding container fc8b36e75f1dcfc2167ab46615ba9dd815087ea2f6c22be2be5ccaf6030937ed: Status 404 returned error can't find the container with id fc8b36e75f1dcfc2167ab46615ba9dd815087ea2f6c22be2be5ccaf6030937ed
Oct 30 02:55:48.376815 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:48.376791    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7a138e6_2485_4134_9d3a_c2419d154f30.slice/crio-f9c5c7233aad79105e81abdd2d0c951b0b3361e2f44442a58e1ffe1ff03ffc18 WatchSource:0}: Error finding container f9c5c7233aad79105e81abdd2d0c951b0b3361e2f44442a58e1ffe1ff03ffc18: Status 404 returned error can't find the container with id f9c5c7233aad79105e81abdd2d0c951b0b3361e2f44442a58e1ffe1ff03ffc18
Oct 30 02:55:48.377958 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:48.377934    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod744bf9e1_3e8b_402c_863a_331a6786f85c.slice/crio-c94fa8df4fb6859663b6ea523064095c2d901b20859d8bbfff400e76f2b56876 WatchSource:0}: Error finding container c94fa8df4fb6859663b6ea523064095c2d901b20859d8bbfff400e76f2b56876: Status 404 returned error can't find the container with id c94fa8df4fb6859663b6ea523064095c2d901b20859d8bbfff400e76f2b56876
Oct 30 02:55:48.379274 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:48.379250    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45836983_c4ed_4083_886b_07e4c4264527.slice/crio-5ce47253647ebabcfb4fb8a9c2e46cfd8ddac87d5787ac3c94e26a82ad950349 WatchSource:0}: Error finding container 5ce47253647ebabcfb4fb8a9c2e46cfd8ddac87d5787ac3c94e26a82ad950349: Status 404 returned error can't find the container with id 5ce47253647ebabcfb4fb8a9c2e46cfd8ddac87d5787ac3c94e26a82ad950349
Oct 30 02:55:48.653968 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:48.653939    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:48.846319 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:48.846258    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:49.048304 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:49.048240    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:49.171303 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:49.171215    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ftq8q" event={"ID":"45836983-c4ed-4083-886b-07e4c4264527","Type":"ContainerStarted","Data":"5ce47253647ebabcfb4fb8a9c2e46cfd8ddac87d5787ac3c94e26a82ad950349"}
Oct 30 02:55:49.173800 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:49.173732    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx" event={"ID":"744bf9e1-3e8b-402c-863a-331a6786f85c","Type":"ContainerStarted","Data":"c94fa8df4fb6859663b6ea523064095c2d901b20859d8bbfff400e76f2b56876"}
Oct 30 02:55:49.175551 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:49.175519    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zxzxk" event={"ID":"e7a138e6-2485-4134-9d3a-c2419d154f30","Type":"ContainerStarted","Data":"f9c5c7233aad79105e81abdd2d0c951b0b3361e2f44442a58e1ffe1ff03ffc18"}
Oct 30 02:55:49.177942 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:49.177917    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67f9ffd857-gnqzw" event={"ID":"deae1b40-455b-40fd-af9a-c9dfa727a018","Type":"ContainerStarted","Data":"a44848cb75636f33a8ac95492ff60ba7dc09b4ec548eeb815b7665a8b87e552d"}
Oct 30 02:55:49.177942 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:49.177955    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67f9ffd857-gnqzw" event={"ID":"deae1b40-455b-40fd-af9a-c9dfa727a018","Type":"ContainerStarted","Data":"fc8b36e75f1dcfc2167ab46615ba9dd815087ea2f6c22be2be5ccaf6030937ed"}
Oct 30 02:55:49.181318 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:49.181288    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7j4nj" event={"ID":"d6cf63fd-2c9b-449d-9fe4-a2503f33a1c0","Type":"ContainerStarted","Data":"8cf2e6119ddba67513f28b53a5e3a991e1c1739cd6c437c062ece2aa35d36490"}
Oct 30 02:55:49.184702 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:49.184282    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-mj9lz" event={"ID":"ed3e2e45-04fe-4fe8-8e88-39439772c950","Type":"ContainerStarted","Data":"0b2a4afc476b6b16e71f02ee439c119e3715e27e180a5e931c150074aacef68b"}
Oct 30 02:55:49.218049 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:49.217549    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:49.391421 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:49.391384    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:49.567962 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:49.567930    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:49.908774 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:49.908670    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:50.038344 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:50.038312    5068 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:50.041598 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:50.041571    5068 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:50.191207 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:50.190634    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-jkkwx" event={"ID":"744bf9e1-3e8b-402c-863a-331a6786f85c","Type":"ContainerStarted","Data":"3b0dc92a9cf498c92f81bd5630ea4a8a21418d81bfec5e127215a7d7321ea995"}
Oct 30 02:55:50.195669 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:50.195645    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zxzxk" event={"ID":"e7a138e6-2485-4134-9d3a-c2419d154f30","Type":"ContainerStarted","Data":"c1f43948483be54c8dca08a8dde32b658031df5718e636e33447371f65b4b71d"}
Oct 30 02:55:50.195777 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:50.195718    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zxzxk" event={"ID":"e7a138e6-2485-4134-9d3a-c2419d154f30","Type":"ContainerStarted","Data":"40d643955b26124fa89ea5d9771772431d43b5bd440fc0dadfc6caa20f7a17ca"}
Oct 30 02:55:50.240941 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:50.240921    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7jm4j"
Oct 30 02:55:50.613234 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:50.613150    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:50.613390 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:50.613290    5068 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 02:55:50.616885 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:50.616862    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-glqfz"
Oct 30 02:55:50.668986 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:50.668958    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:50.855876 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:50.855850    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:51.061624 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:51.061576    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:51.200720 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:51.200680    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ftq8q" event={"ID":"45836983-c4ed-4083-886b-07e4c4264527","Type":"ContainerStarted","Data":"2fefbed407f8b584fe8361d51fef4fb304f866e933da08498901b3d1783e9303"}
Oct 30 02:55:51.200880 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:51.200749    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ftq8q" event={"ID":"45836983-c4ed-4083-886b-07e4c4264527","Type":"ContainerStarted","Data":"6a0912bb3165de2cfbefa1678680c0eebe961f403068170f937eb3b626ee4ccf"}
Oct 30 02:55:51.200880 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:51.200854    5068 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 02:55:51.244475 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:51.244448    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:51.450959 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:51.450934    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:51.982525 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:51.982496    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:51.982670 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:51.982529    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:51.982670 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:51.982577    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:51.984961 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:51.984934    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1eeaa36-b8dc-4f8a-81f4-54b22848135d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9jzff\" (UID: \"b1eeaa36-b8dc-4f8a-81f4-54b22848135d\") " pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:51.985074 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:51.985057    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls\") pod \"image-registry-88cb97fb-qnc8x\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") " pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:51.985163 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:51.985145    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls\") pod \"image-registry-57b8cd6f65-mwg8n\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") " pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:52.057871 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:52.057838    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:52.204772 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:52.204745    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:55:52.229219 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:52.229191    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:52.240156 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:52.240104    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:52.246124 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:52.246110    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:52.248253 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:52.248236    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9jzff"
Oct 30 02:55:52.395746 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:52.395709    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:52.577779 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:52.577705    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57b8cd6f65-mwg8n"]
Oct 30 02:55:52.582483 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:52.582455    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c3241e1_5e8b_48e7_bb0d_6c1928f65d1d.slice/crio-53773b49183ae61b41eab4657b1009c26dcb37349544cb4de3987da8ae20bc7d WatchSource:0}: Error finding container 53773b49183ae61b41eab4657b1009c26dcb37349544cb4de3987da8ae20bc7d: Status 404 returned error can't find the container with id 53773b49183ae61b41eab4657b1009c26dcb37349544cb4de3987da8ae20bc7d
Oct 30 02:55:52.587872 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:52.587833    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-88cb97fb-qnc8x"]
Oct 30 02:55:52.588604 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:52.588579    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9jzff"]
Oct 30 02:55:52.596799 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:52.596773    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f1930a_aa7c_46a0_9a4c_95f35539bf4c.slice/crio-2581113cf71b4881c8fe659890d1fca0ffd31c94a1ede23028b95154f576288c WatchSource:0}: Error finding container 2581113cf71b4881c8fe659890d1fca0ffd31c94a1ede23028b95154f576288c: Status 404 returned error can't find the container with id 2581113cf71b4881c8fe659890d1fca0ffd31c94a1ede23028b95154f576288c
Oct 30 02:55:52.597660 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:55:52.597636    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1eeaa36_b8dc_4f8a_81f4_54b22848135d.slice/crio-fca2df7845bd26ee941d063d079bf3121a615fc577b6ebbdffca32da3d0e7a60 WatchSource:0}: Error finding container fca2df7845bd26ee941d063d079bf3121a615fc577b6ebbdffca32da3d0e7a60: Status 404 returned error can't find the container with id fca2df7845bd26ee941d063d079bf3121a615fc577b6ebbdffca32da3d0e7a60
Oct 30 02:55:53.212951 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:53.212905    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9jzff" event={"ID":"b1eeaa36-b8dc-4f8a-81f4-54b22848135d","Type":"ContainerStarted","Data":"60940d5f49b668f68c4008b72f35443c505b3a5c70219a4494966005a08c14c9"}
Oct 30 02:55:53.213397 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:53.212975    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9jzff" event={"ID":"b1eeaa36-b8dc-4f8a-81f4-54b22848135d","Type":"ContainerStarted","Data":"fca2df7845bd26ee941d063d079bf3121a615fc577b6ebbdffca32da3d0e7a60"}
Oct 30 02:55:53.214514 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:53.214478    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88cb97fb-qnc8x" event={"ID":"80f1930a-aa7c-46a0-9a4c-95f35539bf4c","Type":"ContainerStarted","Data":"7f565cdb4f978ca6001a6cfc202c467fbc2d7c8eca647358edcd1bee1353a150"}
Oct 30 02:55:53.214643 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:53.214526    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:55:53.214643 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:53.214550    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88cb97fb-qnc8x" event={"ID":"80f1930a-aa7c-46a0-9a4c-95f35539bf4c","Type":"ContainerStarted","Data":"2581113cf71b4881c8fe659890d1fca0ffd31c94a1ede23028b95154f576288c"}
Oct 30 02:55:53.216094 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:53.216072    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n" event={"ID":"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d","Type":"ContainerStarted","Data":"2524f8f9741c44936d5566c1db3c04214a56b46d77167d14129885d4bfcf3327"}
Oct 30 02:55:53.216182 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:53.216116    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n" event={"ID":"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d","Type":"ContainerStarted","Data":"53773b49183ae61b41eab4657b1009c26dcb37349544cb4de3987da8ae20bc7d"}
Oct 30 02:55:53.383192 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:53.383169    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:54.222008 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:54.221964    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9jzff" event={"ID":"b1eeaa36-b8dc-4f8a-81f4-54b22848135d","Type":"ContainerStarted","Data":"02f3e1cf75043b0a8a8a8afde67d3b90b317cb372585b2f3f4a385df6eeeb959"}
Oct 30 02:55:54.222008 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:54.222006    5068 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 02:55:54.291843 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:54.291813    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:55:54.292069 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:54.292052    5068 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 02:55:55.227924 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:55.227891    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9jzff" event={"ID":"b1eeaa36-b8dc-4f8a-81f4-54b22848135d","Type":"ContainerStarted","Data":"94bf7434751104886e2dbebf01b9862a6a13994e6efcc17f742261bf571f4bff"}
Oct 30 02:55:55.675264 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:55.675234    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:55.675440 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:55.675375    5068 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 02:55:55.677077 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:55.677055    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-67f9ffd857-gnqzw"
Oct 30 02:55:57.927910 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:57.927883    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-88cb97fb-qnc8x"]
Oct 30 02:55:58.202020 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:58.201948    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:55:58.294709 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:58.294668    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:55:58.393942 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:55:58.393907    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:02.101645 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:02.101604    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:02.218275 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:02.218247    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ftq8q"
Oct 30 02:56:02.333129 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:02.333093    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:03.355488 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:03.355457    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:03.587865 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:03.587829    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:05.048393 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:05.048364    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:05.294769 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:05.294737    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:07.281669 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:56:07.281636    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 02:56:07.364081 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:07.364051    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:07.621559 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:07.621515    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:07.932086 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:07.932017    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:56:08.151606 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:08.151577    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:08.299271 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:08.299208    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:56:08.893309 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:08.893276    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:09.115636 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:09.115605    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:09.620014 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:09.619980    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:09.809004 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:09.808977    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rpbtg"
Oct 30 02:56:09.987908 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:09.987820    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:10.066107 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.066032    5068 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9qbw2"]
Oct 30 02:56:10.102466 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.102443    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.118356 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.118335    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 02:56:10.119104 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.119083    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5fp68\""
Oct 30 02:56:10.119204 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.119188    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 02:56:10.155657 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.155629    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 02:56:10.155797 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.155716    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 02:56:10.218480 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.218456    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-node-exporter-accelerators-collector-config\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.218619 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.218489    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-node-exporter-textfile\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.218619 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.218512    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-node-exporter-tls\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.218619 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.218542    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-node-exporter-wtmp\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.218758 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.218645    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-sys\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.218758 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.218727    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqt45\" (UniqueName: \"kubernetes.io/projected/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-kube-api-access-wqt45\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.218758 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.218754    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-root\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.218864 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.218776    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.218864 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.218817    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-metrics-client-ca\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.319644 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.319582    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-node-exporter-tls\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.319644 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.319617    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-node-exporter-wtmp\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.319644 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.319635    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-sys\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.319896 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.319670    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqt45\" (UniqueName: \"kubernetes.io/projected/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-kube-api-access-wqt45\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.319896 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.319725    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-root\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.319896 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.319735    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-sys\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.319896 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.319754    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.319896 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.319792    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-metrics-client-ca\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.319896 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.319799    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-root\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.319896 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.319804    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-node-exporter-wtmp\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.319896 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.319847    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-node-exporter-accelerators-collector-config\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.319896 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.319875    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-node-exporter-textfile\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.320326 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.320167    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-node-exporter-textfile\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.320385 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.320358    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-node-exporter-accelerators-collector-config\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.320439 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.320384    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-metrics-client-ca\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.321941 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.321921    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-node-exporter-tls\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.322046 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.322027    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.344175 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.344150    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:10.346650 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.346630    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqt45\" (UniqueName: \"kubernetes.io/projected/828fa7d3-05b9-4bc9-a0cf-587cde0d64ec-kube-api-access-wqt45\") pod \"node-exporter-9qbw2\" (UID: \"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec\") " pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.450787 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.450762    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9qbw2"
Oct 30 02:56:10.485848 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:56:10.485822    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod828fa7d3_05b9_4bc9_a0cf_587cde0d64ec.slice/crio-04e987cefb28c224d6a1259ecd53eadedd6dde2875296e24d7163f64e9c78f96 WatchSource:0}: Error finding container 04e987cefb28c224d6a1259ecd53eadedd6dde2875296e24d7163f64e9c78f96: Status 404 returned error can't find the container with id 04e987cefb28c224d6a1259ecd53eadedd6dde2875296e24d7163f64e9c78f96
Oct 30 02:56:10.585722 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.585637    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:10.813319 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:10.813288    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:11.020135 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:11.020084    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:11.230842 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:11.230814    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:11.290736 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:11.290648    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qbw2" event={"ID":"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec","Type":"ContainerStarted","Data":"04e987cefb28c224d6a1259ecd53eadedd6dde2875296e24d7163f64e9c78f96"}
Oct 30 02:56:11.440581 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:11.440543    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:12.296063 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:12.295988    5068 generic.go:356] "Generic (PLEG): container finished" podID="828fa7d3-05b9-4bc9-a0cf-587cde0d64ec" containerID="c7dad54e0b37e487aec80f5f1f29a5c0f2714ea7eeea745997f59c457ed34cb6" exitCode=0
Oct 30 02:56:12.296423 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:12.296071    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qbw2" event={"ID":"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec","Type":"ContainerDied","Data":"c7dad54e0b37e487aec80f5f1f29a5c0f2714ea7eeea745997f59c457ed34cb6"}
Oct 30 02:56:13.311305 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:13.311268    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qbw2" event={"ID":"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec","Type":"ContainerStarted","Data":"d1cfae829b92400866b7e1c6cc8a17d3ab795891ababef59e7d277868cc5fe45"}
Oct 30 02:56:13.311817 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:13.311328    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qbw2" event={"ID":"828fa7d3-05b9-4bc9-a0cf-587cde0d64ec","Type":"ContainerStarted","Data":"0df404909a1ae943f5e2612824b3d4b261698983c1f0f861e40ec8c284e54b26"}
Oct 30 02:56:13.379156 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:13.379080    5068 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9qbw2" podStartSLOduration=1.888640466 podStartE2EDuration="3.379061139s" totalImagesPullingTime="1.40752982s" totalInitContainerRuntime="82.890853ms" isStatefulPod=true podCreationTimestamp="2026-10-30 02:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:56:13.368837848 +0000 UTC m=+30.444208062" watchObservedRunningTime="2026-10-30 02:56:13.379061139 +0000 UTC m=+30.454431350"
Oct 30 02:56:13.457278 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:13.457239    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:13.716940 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:13.716903    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:13.979851 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:13.979744    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:14.739409 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:14.739375    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:15.058521 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:15.058420    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:15.597614 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:15.597584    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:15.854864 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:15.854785    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:16.830703 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:16.830645    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:17.273628 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:17.273597    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:17.550926 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:17.550854    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:17.621148 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:17.621118    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p7mkl"
Oct 30 02:56:17.871847 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:17.871819    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:19.658960 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:19.658913    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:19.845619 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:19.845585    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:20.875781 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:20.875750    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57b8cd6f65-mwg8n"]
Oct 30 02:56:21.091634 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:21.091602    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:21.374893 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:21.374859    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:22.247065 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:22.247024    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:22.526327 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:22.526243    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:22.949819 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:22.949774    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-88cb97fb-qnc8x" podUID="80f1930a-aa7c-46a0-9a4c-95f35539bf4c" containerName="registry" containerID="cri-o://7f565cdb4f978ca6001a6cfc202c467fbc2d7c8eca647358edcd1bee1353a150" gracePeriod=30
Oct 30 02:56:23.070170 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.070139    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:23.202946 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.202895    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:56:23.326674 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.326641    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:23.328667 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.328641    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls\") pod \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") "
Oct 30 02:56:23.328814 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.328711    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-trusted-ca\") pod \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") "
Oct 30 02:56:23.328814 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.328764    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-image-registry-private-configuration\") pod \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") "
Oct 30 02:56:23.328814 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.328791    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-ca-trust-extracted\") pod \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") "
Oct 30 02:56:23.329002 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.328833    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-kube-api-access-t8c9g\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-kube-api-access-t8c9g\") pod \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") "
Oct 30 02:56:23.329002 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.328865    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-bound-sa-token\") pod \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") "
Oct 30 02:56:23.329002 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.328903    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-certificates\") pod \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") "
Oct 30 02:56:23.329002 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.328967    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-installation-pull-secrets\") pod \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\" (UID: \"80f1930a-aa7c-46a0-9a4c-95f35539bf4c\") "
Oct 30 02:56:23.329414 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.329345    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-certificates" pod "80f1930a-aa7c-46a0-9a4c-95f35539bf4c" (UID: "80f1930a-aa7c-46a0-9a4c-95f35539bf4c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:56:23.329660 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.329640    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-trusted-ca" pod "80f1930a-aa7c-46a0-9a4c-95f35539bf4c" (UID: "80f1930a-aa7c-46a0-9a4c-95f35539bf4c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:56:23.331840 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.331813    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls" pod "80f1930a-aa7c-46a0-9a4c-95f35539bf4c" (UID: "80f1930a-aa7c-46a0-9a4c-95f35539bf4c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 02:56:23.331954 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.331832    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-image-registry-private-configuration" pod "80f1930a-aa7c-46a0-9a4c-95f35539bf4c" (UID: "80f1930a-aa7c-46a0-9a4c-95f35539bf4c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:56:23.331954 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.331855    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-bound-sa-token" pod "80f1930a-aa7c-46a0-9a4c-95f35539bf4c" (UID: "80f1930a-aa7c-46a0-9a4c-95f35539bf4c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 02:56:23.331954 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.331916    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-kube-api-access-t8c9g" pod "80f1930a-aa7c-46a0-9a4c-95f35539bf4c" (UID: "80f1930a-aa7c-46a0-9a4c-95f35539bf4c"). InnerVolumeSpecName "kube-api-access-t8c9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 02:56:23.332070 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.332002    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-installation-pull-secrets" pod "80f1930a-aa7c-46a0-9a4c-95f35539bf4c" (UID: "80f1930a-aa7c-46a0-9a4c-95f35539bf4c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:56:23.336499 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.336476    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-ca-trust-extracted" pod "80f1930a-aa7c-46a0-9a4c-95f35539bf4c" (UID: "80f1930a-aa7c-46a0-9a4c-95f35539bf4c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 02:56:23.358124 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.358094    5068 generic.go:356] "Generic (PLEG): container finished" podID="80f1930a-aa7c-46a0-9a4c-95f35539bf4c" containerID="7f565cdb4f978ca6001a6cfc202c467fbc2d7c8eca647358edcd1bee1353a150" exitCode=0
Oct 30 02:56:23.358220 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.358143    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88cb97fb-qnc8x"
Oct 30 02:56:23.358259 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.358223    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88cb97fb-qnc8x" event={"ID":"80f1930a-aa7c-46a0-9a4c-95f35539bf4c","Type":"ContainerDied","Data":"7f565cdb4f978ca6001a6cfc202c467fbc2d7c8eca647358edcd1bee1353a150"}
Oct 30 02:56:23.358309 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.358296    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88cb97fb-qnc8x" event={"ID":"80f1930a-aa7c-46a0-9a4c-95f35539bf4c","Type":"ContainerDied","Data":"2581113cf71b4881c8fe659890d1fca0ffd31c94a1ede23028b95154f576288c"}
Oct 30 02:56:23.358345 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.358325    5068 scope.go:122] "RemoveContainer" containerID="7f565cdb4f978ca6001a6cfc202c467fbc2d7c8eca647358edcd1bee1353a150"
Oct 30 02:56:23.369813 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.369793    5068 scope.go:122] "RemoveContainer" containerID="7f565cdb4f978ca6001a6cfc202c467fbc2d7c8eca647358edcd1bee1353a150"
Oct 30 02:56:23.370110 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:56:23.370089    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f565cdb4f978ca6001a6cfc202c467fbc2d7c8eca647358edcd1bee1353a150\": container with ID starting with 7f565cdb4f978ca6001a6cfc202c467fbc2d7c8eca647358edcd1bee1353a150 not found: ID does not exist" containerID="7f565cdb4f978ca6001a6cfc202c467fbc2d7c8eca647358edcd1bee1353a150"
Oct 30 02:56:23.370183 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.370116    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f565cdb4f978ca6001a6cfc202c467fbc2d7c8eca647358edcd1bee1353a150"} err="failed to get container status \"7f565cdb4f978ca6001a6cfc202c467fbc2d7c8eca647358edcd1bee1353a150\": rpc error: code = NotFound desc = could not find container \"7f565cdb4f978ca6001a6cfc202c467fbc2d7c8eca647358edcd1bee1353a150\": container with ID starting with 7f565cdb4f978ca6001a6cfc202c467fbc2d7c8eca647358edcd1bee1353a150 not found: ID does not exist"
Oct 30 02:56:23.403634 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.403610    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-88cb97fb-qnc8x"]
Oct 30 02:56:23.407680 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.407656    5068 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-88cb97fb-qnc8x"]
Oct 30 02:56:23.429951 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.429928    5068 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-installation-pull-secrets\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:56:23.429951 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.429947    5068 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-tls\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:56:23.430071 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.429958    5068 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-trusted-ca\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:56:23.430071 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.429968    5068 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-image-registry-private-configuration\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:56:23.430071 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.429977    5068 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-ca-trust-extracted\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:56:23.430071 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.429987    5068 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8c9g\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-kube-api-access-t8c9g\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:56:23.430071 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.429996    5068 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-bound-sa-token\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:56:23.430071 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:23.430004    5068 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80f1930a-aa7c-46a0-9a4c-95f35539bf4c-registry-certificates\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:56:24.031728 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:24.031669    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:24.276906 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:24.276866    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:25.071523 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:25.071451    5068 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="80f1930a-aa7c-46a0-9a4c-95f35539bf4c" path="/var/lib/kubelet/pods/80f1930a-aa7c-46a0-9a4c-95f35539bf4c/volumes"
Oct 30 02:56:25.430237 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:25.430205    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:25.689580 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:25.689502    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:32.519366 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:32.519323    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:32.732808 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:32.732774    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:36.776452 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:36.776415    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:36.991994 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:36.991956    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:37.280600 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:56:37.280566    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 02:56:42.632189 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:42.632146    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:42.808864 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:42.808829    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:45.898985 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:45.898920    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n" podUID="8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" containerName="registry" containerID="cri-o://2524f8f9741c44936d5566c1db3c04214a56b46d77167d14129885d4bfcf3327" gracePeriod=30
Oct 30 02:56:46.145087 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.145060    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:56:46.306992 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.306925    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-trusted-ca\") pod \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") "
Oct 30 02:56:46.306992 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.306976    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls\") pod \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") "
Oct 30 02:56:46.307200 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.306995    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-certificates\") pod \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") "
Oct 30 02:56:46.307200 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.307029    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-installation-pull-secrets\") pod \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") "
Oct 30 02:56:46.307200 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.307049    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-image-registry-private-configuration\") pod \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") "
Oct 30 02:56:46.307200 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.307073    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-ca-trust-extracted\") pod \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") "
Oct 30 02:56:46.307200 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.307151    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-bound-sa-token\") pod \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") "
Oct 30 02:56:46.307200 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.307197    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-kube-api-access-br65p\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-kube-api-access-br65p\") pod \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\" (UID: \"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d\") "
Oct 30 02:56:46.307504 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.307420    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-trusted-ca" pod "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" (UID: "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:56:46.307558 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.307493    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-certificates" pod "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" (UID: "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:56:46.309430 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.309392    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-image-registry-private-configuration" pod "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" (UID: "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:56:46.309560 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.309485    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls" pod "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" (UID: "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 02:56:46.309743 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.309719    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-installation-pull-secrets" pod "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" (UID: "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:56:46.309876 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.309859    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-kube-api-access-br65p" pod "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" (UID: "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d"). InnerVolumeSpecName "kube-api-access-br65p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 02:56:46.309960 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.309938    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-bound-sa-token" pod "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" (UID: "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 02:56:46.314259 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.314168    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-ca-trust-extracted" pod "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" (UID: "8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 02:56:46.408366 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.408342    5068 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-installation-pull-secrets\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:56:46.408453 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.408366    5068 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-image-registry-private-configuration\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:56:46.408453 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.408378    5068 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-ca-trust-extracted\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:56:46.408453 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.408389    5068 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-bound-sa-token\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:56:46.408453 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.408398    5068 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-br65p\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-kube-api-access-br65p\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:56:46.408453 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.408407    5068 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-trusted-ca\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:56:46.408453 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.408415    5068 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-tls\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:56:46.408453 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.408423    5068 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d-registry-certificates\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:56:46.452379 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.452339    5068 generic.go:356] "Generic (PLEG): container finished" podID="8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" containerID="2524f8f9741c44936d5566c1db3c04214a56b46d77167d14129885d4bfcf3327" exitCode=0
Oct 30 02:56:46.452496 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.452385    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n"
Oct 30 02:56:46.452496 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.452406    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n" event={"ID":"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d","Type":"ContainerDied","Data":"2524f8f9741c44936d5566c1db3c04214a56b46d77167d14129885d4bfcf3327"}
Oct 30 02:56:46.452496 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.452460    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57b8cd6f65-mwg8n" event={"ID":"8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d","Type":"ContainerDied","Data":"53773b49183ae61b41eab4657b1009c26dcb37349544cb4de3987da8ae20bc7d"}
Oct 30 02:56:46.452496 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.452490    5068 scope.go:122] "RemoveContainer" containerID="2524f8f9741c44936d5566c1db3c04214a56b46d77167d14129885d4bfcf3327"
Oct 30 02:56:46.461656 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.461640    5068 scope.go:122] "RemoveContainer" containerID="2524f8f9741c44936d5566c1db3c04214a56b46d77167d14129885d4bfcf3327"
Oct 30 02:56:46.461983 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:56:46.461964    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2524f8f9741c44936d5566c1db3c04214a56b46d77167d14129885d4bfcf3327\": container with ID starting with 2524f8f9741c44936d5566c1db3c04214a56b46d77167d14129885d4bfcf3327 not found: ID does not exist" containerID="2524f8f9741c44936d5566c1db3c04214a56b46d77167d14129885d4bfcf3327"
Oct 30 02:56:46.462023 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.461991    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2524f8f9741c44936d5566c1db3c04214a56b46d77167d14129885d4bfcf3327"} err="failed to get container status \"2524f8f9741c44936d5566c1db3c04214a56b46d77167d14129885d4bfcf3327\": rpc error: code = NotFound desc = could not find container \"2524f8f9741c44936d5566c1db3c04214a56b46d77167d14129885d4bfcf3327\": container with ID starting with 2524f8f9741c44936d5566c1db3c04214a56b46d77167d14129885d4bfcf3327 not found: ID does not exist"
Oct 30 02:56:46.499545 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.499514    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57b8cd6f65-mwg8n"]
Oct 30 02:56:46.509254 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.509226    5068 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57b8cd6f65-mwg8n"]
Oct 30 02:56:46.769896 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.769868    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:46.958465 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:46.958435    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:47.071893 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:47.071826    5068 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" path="/var/lib/kubelet/pods/8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d/volumes"
Oct 30 02:56:47.173100 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:47.173072    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:56.105160 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:56.105122    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:56:56.280566 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:56:56.280533    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:57:05.977812 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:05.977771    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:57:06.217526 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:06.217492    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:57:06.956224 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:06.956192    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:57:07.281372 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:57:07.281289    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 02:57:09.504265 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:09.504226    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:57:11.547974 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:11.547896    5068 generic.go:356] "Generic (PLEG): container finished" podID="0155b708-711a-4794-9fd5-bd88e9cae690" containerID="058dcea2605047d8ef1e3e5127ec625213ae3dfcba96a1cd38e764611c55ec44" exitCode=0
Oct 30 02:57:11.548332 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:11.547968    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-kss29" event={"ID":"0155b708-711a-4794-9fd5-bd88e9cae690","Type":"ContainerDied","Data":"058dcea2605047d8ef1e3e5127ec625213ae3dfcba96a1cd38e764611c55ec44"}
Oct 30 02:57:11.548332 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:11.548237    5068 scope.go:122] "RemoveContainer" containerID="058dcea2605047d8ef1e3e5127ec625213ae3dfcba96a1cd38e764611c55ec44"
Oct 30 02:57:11.995154 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:11.995121    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-bf2qb-x5rb9"]
Oct 30 02:57:11.995335 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:11.995314    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-bf2qb-x5rb9" podUID="07c431ff-4edd-45b1-b72d-5c3d2b66bfdc" containerName="insights-gathering" containerID="cri-o://dfd67a3d37523d05cd2698d2d39365ff380eb40adc61364a34c339633d6a018e" gracePeriod=30
Oct 30 02:57:12.173978 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.173947    5068 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-xvhvb-6sczn"]
Oct 30 02:57:12.174451 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.174404    5068 cpu_manager.go:414] "containerMap: removing container" podUID="8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" containerName="registry"
Oct 30 02:57:12.174451 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.174425    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" containerName="registry"
Oct 30 02:57:12.174677 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.174472    5068 cpu_manager.go:414] "containerMap: removing container" podUID="80f1930a-aa7c-46a0-9a4c-95f35539bf4c" containerName="registry"
Oct 30 02:57:12.174677 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.174484    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="80f1930a-aa7c-46a0-9a4c-95f35539bf4c" containerName="registry"
Oct 30 02:57:12.174841 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.174822    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="8c3241e1-5e8b-48e7-bb0d-6c1928f65d1d" containerName="registry"
Oct 30 02:57:12.174881 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.174851    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="80f1930a-aa7c-46a0-9a4c-95f35539bf4c" containerName="registry"
Oct 30 02:57:12.177839 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.177821    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-xvhvb-6sczn"
Oct 30 02:57:12.198435 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.198408    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-xvhvb-6sczn"]
Oct 30 02:57:12.241097 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.241077    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:57:12.297784 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.297724    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-kube-api-access-jb76r\" (UniqueName: \"kubernetes.io/projected/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-kube-api-access-jb76r\") pod \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") "
Oct 30 02:57:12.297784 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.297760    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-archives-path\") pod \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") "
Oct 30 02:57:12.297926 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.297787    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-service-ca-bundle\") pod \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") "
Oct 30 02:57:12.297926 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.297820    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-trusted-ca-bundle\") pod \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\" (UID: \"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc\") "
Oct 30 02:57:12.298015 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.297920    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/07958720-e19a-4054-90ae-0c0cd052f807-archives-path\") pod \"periodic-gathering-xvhvb-6sczn\" (UID: \"07958720-e19a-4054-90ae-0c0cd052f807\") " pod="openshift-insights/periodic-gathering-xvhvb-6sczn"
Oct 30 02:57:12.298015 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.297966    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07958720-e19a-4054-90ae-0c0cd052f807-trusted-ca-bundle\") pod \"periodic-gathering-xvhvb-6sczn\" (UID: \"07958720-e19a-4054-90ae-0c0cd052f807\") " pod="openshift-insights/periodic-gathering-xvhvb-6sczn"
Oct 30 02:57:12.298108 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.298071    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-archives-path" pod "07c431ff-4edd-45b1-b72d-5c3d2b66bfdc" (UID: "07c431ff-4edd-45b1-b72d-5c3d2b66bfdc"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 02:57:12.298154 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.298098    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fllnm\" (UniqueName: \"kubernetes.io/projected/07958720-e19a-4054-90ae-0c0cd052f807-kube-api-access-fllnm\") pod \"periodic-gathering-xvhvb-6sczn\" (UID: \"07958720-e19a-4054-90ae-0c0cd052f807\") " pod="openshift-insights/periodic-gathering-xvhvb-6sczn"
Oct 30 02:57:12.298192 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.298160    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-service-ca-bundle" pod "07c431ff-4edd-45b1-b72d-5c3d2b66bfdc" (UID: "07c431ff-4edd-45b1-b72d-5c3d2b66bfdc"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:57:12.298244 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.298226    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-trusted-ca-bundle" pod "07c431ff-4edd-45b1-b72d-5c3d2b66bfdc" (UID: "07c431ff-4edd-45b1-b72d-5c3d2b66bfdc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:57:12.298284 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.298240    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07958720-e19a-4054-90ae-0c0cd052f807-service-ca-bundle\") pod \"periodic-gathering-xvhvb-6sczn\" (UID: \"07958720-e19a-4054-90ae-0c0cd052f807\") " pod="openshift-insights/periodic-gathering-xvhvb-6sczn"
Oct 30 02:57:12.298284 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.298282    5068 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-archives-path\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:57:12.298358 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.298293    5068 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-service-ca-bundle\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:57:12.298358 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.298302    5068 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-trusted-ca-bundle\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:57:12.299949 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.299931    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-kube-api-access-jb76r" pod "07c431ff-4edd-45b1-b72d-5c3d2b66bfdc" (UID: "07c431ff-4edd-45b1-b72d-5c3d2b66bfdc"). InnerVolumeSpecName "kube-api-access-jb76r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 02:57:12.399375 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.399350    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07958720-e19a-4054-90ae-0c0cd052f807-trusted-ca-bundle\") pod \"periodic-gathering-xvhvb-6sczn\" (UID: \"07958720-e19a-4054-90ae-0c0cd052f807\") " pod="openshift-insights/periodic-gathering-xvhvb-6sczn"
Oct 30 02:57:12.399477 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.399389    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fllnm\" (UniqueName: \"kubernetes.io/projected/07958720-e19a-4054-90ae-0c0cd052f807-kube-api-access-fllnm\") pod \"periodic-gathering-xvhvb-6sczn\" (UID: \"07958720-e19a-4054-90ae-0c0cd052f807\") " pod="openshift-insights/periodic-gathering-xvhvb-6sczn"
Oct 30 02:57:12.399477 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.399416    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07958720-e19a-4054-90ae-0c0cd052f807-service-ca-bundle\") pod \"periodic-gathering-xvhvb-6sczn\" (UID: \"07958720-e19a-4054-90ae-0c0cd052f807\") " pod="openshift-insights/periodic-gathering-xvhvb-6sczn"
Oct 30 02:57:12.399477 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.399469    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/07958720-e19a-4054-90ae-0c0cd052f807-archives-path\") pod \"periodic-gathering-xvhvb-6sczn\" (UID: \"07958720-e19a-4054-90ae-0c0cd052f807\") " pod="openshift-insights/periodic-gathering-xvhvb-6sczn"
Oct 30 02:57:12.399575 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.399507    5068 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jb76r\" (UniqueName: \"kubernetes.io/projected/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc-kube-api-access-jb76r\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:57:12.399884 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.399869    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/07958720-e19a-4054-90ae-0c0cd052f807-archives-path\") pod \"periodic-gathering-xvhvb-6sczn\" (UID: \"07958720-e19a-4054-90ae-0c0cd052f807\") " pod="openshift-insights/periodic-gathering-xvhvb-6sczn"
Oct 30 02:57:12.400221 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.400197    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07958720-e19a-4054-90ae-0c0cd052f807-service-ca-bundle\") pod \"periodic-gathering-xvhvb-6sczn\" (UID: \"07958720-e19a-4054-90ae-0c0cd052f807\") " pod="openshift-insights/periodic-gathering-xvhvb-6sczn"
Oct 30 02:57:12.400271 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.400255    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07958720-e19a-4054-90ae-0c0cd052f807-trusted-ca-bundle\") pod \"periodic-gathering-xvhvb-6sczn\" (UID: \"07958720-e19a-4054-90ae-0c0cd052f807\") " pod="openshift-insights/periodic-gathering-xvhvb-6sczn"
Oct 30 02:57:12.421664 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.421633    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fllnm\" (UniqueName: \"kubernetes.io/projected/07958720-e19a-4054-90ae-0c0cd052f807-kube-api-access-fllnm\") pod \"periodic-gathering-xvhvb-6sczn\" (UID: \"07958720-e19a-4054-90ae-0c0cd052f807\") " pod="openshift-insights/periodic-gathering-xvhvb-6sczn"
Oct 30 02:57:12.490585 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.490555    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-xvhvb-6sczn"
Oct 30 02:57:12.554987 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.554918    5068 generic.go:356] "Generic (PLEG): container finished" podID="07c431ff-4edd-45b1-b72d-5c3d2b66bfdc" containerID="dfd67a3d37523d05cd2698d2d39365ff380eb40adc61364a34c339633d6a018e" exitCode=2
Oct 30 02:57:12.554987 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.554965    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-bf2qb-x5rb9"
Oct 30 02:57:12.555468 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.555030    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-bf2qb-x5rb9" event={"ID":"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc","Type":"ContainerDied","Data":"dfd67a3d37523d05cd2698d2d39365ff380eb40adc61364a34c339633d6a018e"}
Oct 30 02:57:12.555468 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.555069    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-bf2qb-x5rb9" event={"ID":"07c431ff-4edd-45b1-b72d-5c3d2b66bfdc","Type":"ContainerDied","Data":"93de7f62dfb50c8fdd6431acbf6e83b5eeb451c7f6dd09d9443832a3961acf08"}
Oct 30 02:57:12.555468 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.555093    5068 scope.go:122] "RemoveContainer" containerID="dfd67a3d37523d05cd2698d2d39365ff380eb40adc61364a34c339633d6a018e"
Oct 30 02:57:12.560821 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.560122    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-kss29" event={"ID":"0155b708-711a-4794-9fd5-bd88e9cae690","Type":"ContainerStarted","Data":"c9bb4966e412607919f4809169a2361820dbde9096fba6382fa29d0a0d964c7a"}
Oct 30 02:57:12.566732 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.566713    5068 scope.go:122] "RemoveContainer" containerID="dfd67a3d37523d05cd2698d2d39365ff380eb40adc61364a34c339633d6a018e"
Oct 30 02:57:12.567012 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:57:12.566993    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfd67a3d37523d05cd2698d2d39365ff380eb40adc61364a34c339633d6a018e\": container with ID starting with dfd67a3d37523d05cd2698d2d39365ff380eb40adc61364a34c339633d6a018e not found: ID does not exist" containerID="dfd67a3d37523d05cd2698d2d39365ff380eb40adc61364a34c339633d6a018e"
Oct 30 02:57:12.567065 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.567022    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd67a3d37523d05cd2698d2d39365ff380eb40adc61364a34c339633d6a018e"} err="failed to get container status \"dfd67a3d37523d05cd2698d2d39365ff380eb40adc61364a34c339633d6a018e\": rpc error: code = NotFound desc = could not find container \"dfd67a3d37523d05cd2698d2d39365ff380eb40adc61364a34c339633d6a018e\": container with ID starting with dfd67a3d37523d05cd2698d2d39365ff380eb40adc61364a34c339633d6a018e not found: ID does not exist"
Oct 30 02:57:12.603036 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.603009    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-bf2qb-x5rb9"]
Oct 30 02:57:12.606375 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.606351    5068 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-bf2qb-x5rb9"]
Oct 30 02:57:12.799366 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:12.799333    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-xvhvb-6sczn"]
Oct 30 02:57:12.804059 ip-10-0-139-40 kubenswrapper[5068]: W1030 02:57:12.804024    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07958720_e19a_4054_90ae_0c0cd052f807.slice/crio-e78e29adf2cad90d2e2326b69e42a35d986bcc1d7aa5819b656009b69da0c6a8 WatchSource:0}: Error finding container e78e29adf2cad90d2e2326b69e42a35d986bcc1d7aa5819b656009b69da0c6a8: Status 404 returned error can't find the container with id e78e29adf2cad90d2e2326b69e42a35d986bcc1d7aa5819b656009b69da0c6a8
Oct 30 02:57:13.070387 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:13.070310    5068 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="07c431ff-4edd-45b1-b72d-5c3d2b66bfdc" path="/var/lib/kubelet/pods/07c431ff-4edd-45b1-b72d-5c3d2b66bfdc/volumes"
Oct 30 02:57:13.565731 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:13.565680    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-xvhvb-6sczn" event={"ID":"07958720-e19a-4054-90ae-0c0cd052f807","Type":"ContainerStarted","Data":"832f32d3e315e14b64f8765b4465b4f8b9537bdf093d0b7fca4f26adbb1a47e8"}
Oct 30 02:57:13.566250 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:13.565752    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-xvhvb-6sczn" event={"ID":"07958720-e19a-4054-90ae-0c0cd052f807","Type":"ContainerStarted","Data":"e78e29adf2cad90d2e2326b69e42a35d986bcc1d7aa5819b656009b69da0c6a8"}
Oct 30 02:57:13.602056 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:13.602014    5068 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-xvhvb-6sczn" podStartSLOduration=1.60200126 podStartE2EDuration="1.60200126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:57:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:57:13.60187363 +0000 UTC m=+90.677243842" watchObservedRunningTime="2026-10-30 02:57:13.60200126 +0000 UTC m=+90.677371471"
Oct 30 02:57:17.165330 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:17.165292    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:57:17.407934 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:17.407907    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:57:32.557339 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:32.557307    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:57:34.189182 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:34.189147    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:57:34.368763 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:34.368720    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:57:34.545719 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:57:34.545634    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:57:37.280920 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:57:37.280879    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 02:58:07.280517 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:58:07.280439    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 02:58:11.876406 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:11.876364    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:58:32.686783 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:32.686735    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:58:36.886029 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:36.885995    5068 generic.go:356] "Generic (PLEG): container finished" podID="07958720-e19a-4054-90ae-0c0cd052f807" containerID="832f32d3e315e14b64f8765b4465b4f8b9537bdf093d0b7fca4f26adbb1a47e8" exitCode=0
Oct 30 02:58:36.886409 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:36.886045    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-xvhvb-6sczn" event={"ID":"07958720-e19a-4054-90ae-0c0cd052f807","Type":"ContainerDied","Data":"832f32d3e315e14b64f8765b4465b4f8b9537bdf093d0b7fca4f26adbb1a47e8"}
Oct 30 02:58:37.281726 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:58:37.281632    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 02:58:38.012209 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:38.012184    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-xvhvb-6sczn"
Oct 30 02:58:38.021369 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:38.021347    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/07958720-e19a-4054-90ae-0c0cd052f807-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07958720-e19a-4054-90ae-0c0cd052f807-trusted-ca-bundle\") pod \"07958720-e19a-4054-90ae-0c0cd052f807\" (UID: \"07958720-e19a-4054-90ae-0c0cd052f807\") "
Oct 30 02:58:38.021509 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:38.021381    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/07958720-e19a-4054-90ae-0c0cd052f807-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07958720-e19a-4054-90ae-0c0cd052f807-service-ca-bundle\") pod \"07958720-e19a-4054-90ae-0c0cd052f807\" (UID: \"07958720-e19a-4054-90ae-0c0cd052f807\") "
Oct 30 02:58:38.021509 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:38.021428    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07958720-e19a-4054-90ae-0c0cd052f807-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/07958720-e19a-4054-90ae-0c0cd052f807-archives-path\") pod \"07958720-e19a-4054-90ae-0c0cd052f807\" (UID: \"07958720-e19a-4054-90ae-0c0cd052f807\") "
Oct 30 02:58:38.021509 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:38.021481    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07958720-e19a-4054-90ae-0c0cd052f807-kube-api-access-fllnm\" (UniqueName: \"kubernetes.io/projected/07958720-e19a-4054-90ae-0c0cd052f807-kube-api-access-fllnm\") pod \"07958720-e19a-4054-90ae-0c0cd052f807\" (UID: \"07958720-e19a-4054-90ae-0c0cd052f807\") "
Oct 30 02:58:38.021808 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:38.021785    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07958720-e19a-4054-90ae-0c0cd052f807-trusted-ca-bundle" pod "07958720-e19a-4054-90ae-0c0cd052f807" (UID: "07958720-e19a-4054-90ae-0c0cd052f807"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:58:38.021870 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:38.021814    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07958720-e19a-4054-90ae-0c0cd052f807-service-ca-bundle" pod "07958720-e19a-4054-90ae-0c0cd052f807" (UID: "07958720-e19a-4054-90ae-0c0cd052f807"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:58:38.021870 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:38.021839    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07958720-e19a-4054-90ae-0c0cd052f807-archives-path" pod "07958720-e19a-4054-90ae-0c0cd052f807" (UID: "07958720-e19a-4054-90ae-0c0cd052f807"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 02:58:38.023482 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:38.023462    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07958720-e19a-4054-90ae-0c0cd052f807-kube-api-access-fllnm" pod "07958720-e19a-4054-90ae-0c0cd052f807" (UID: "07958720-e19a-4054-90ae-0c0cd052f807"). InnerVolumeSpecName "kube-api-access-fllnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 02:58:38.122080 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:38.122044    5068 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fllnm\" (UniqueName: \"kubernetes.io/projected/07958720-e19a-4054-90ae-0c0cd052f807-kube-api-access-fllnm\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:58:38.122080 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:38.122075    5068 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07958720-e19a-4054-90ae-0c0cd052f807-trusted-ca-bundle\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:58:38.122080 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:38.122084    5068 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07958720-e19a-4054-90ae-0c0cd052f807-service-ca-bundle\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:58:38.122307 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:38.122093    5068 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/07958720-e19a-4054-90ae-0c0cd052f807-archives-path\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 02:58:38.894500 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:38.894463    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-xvhvb-6sczn" event={"ID":"07958720-e19a-4054-90ae-0c0cd052f807","Type":"ContainerDied","Data":"e78e29adf2cad90d2e2326b69e42a35d986bcc1d7aa5819b656009b69da0c6a8"}
Oct 30 02:58:38.894500 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:38.894496    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-xvhvb-6sczn"
Oct 30 02:58:38.894726 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:38.894512    5068 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e78e29adf2cad90d2e2326b69e42a35d986bcc1d7aa5819b656009b69da0c6a8"
Oct 30 02:58:39.370811 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:39.370783    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:58:39.540781 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:58:39.540742    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:59:07.280846 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:59:07.280805    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 02:59:12.304354 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:59:12.304315    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:59:12.492522 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:59:12.492486    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:59:32.818016 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:59:32.817938    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:59:37.280844 ip-10-0-139-40 kubenswrapper[5068]: E1030 02:59:37.280806    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 02:59:53.563018 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:59:53.562975    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 02:59:53.737023 ip-10-0-139-40 kubenswrapper[5068]: I1030 02:59:53.736993    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:00:07.280709 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:00:07.280648    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:00:32.954545 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:00:32.954507    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:00:37.280700 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:00:37.280652    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:00:43.086869 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:00:43.086835    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/1.log"
Oct 30 03:00:43.087867 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:00:43.087846    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/1.log"
Oct 30 03:00:47.381639 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:00:47.381598    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:00:50.366870 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:00:50.366832    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:00:50.533877 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:00:50.533844    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:01:07.281743 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:01:07.281649    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:01:15.590576 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:01:15.590537    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:01:15.760089 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:01:15.760057    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:01:18.496472 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:01:18.496434    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:01:18.750248 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:01:18.750164    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:01:27.306561 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:01:27.306524    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:01:27.490450 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:01:27.490414    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:01:28.519037 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:01:28.519003    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:01:33.086066 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:01:33.086032    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:01:37.280495 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:01:37.280458    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:01:51.827461 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:01:51.827428    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:01:52.008492 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:01:52.008460    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:01:57.556957 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:01:57.556921    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:01:58.292745 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:01:58.292712    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:01:58.540069 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:01:58.540034    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:01:59.461849 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:01:59.461815    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:01:59.939762 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:01:59.939723    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:02:00.174995 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:02:00.174960    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:02:00.579301 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:02:00.579269    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:02:00.880853 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:02:00.880825    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:02:01.067073 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:02:01.067039    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:02:01.280232 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:02:01.280141    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:02:07.281372 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:02:07.281338    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:02:33.226452 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:02:33.226382    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:02:37.281064 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:02:37.281027    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:02:51.748942 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:02:51.748906    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:02:51.925178 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:02:51.925144    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:03:07.282221 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:03:07.282180    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:03:27.393405 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.393349    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:03:27.452330 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.452298    5068 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-59b8df5579-pc8sk"]
Oct 30 03:03:27.452612 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.452600    5068 cpu_manager.go:414] "containerMap: removing container" podUID="07958720-e19a-4054-90ae-0c0cd052f807" containerName="insights-gathering"
Oct 30 03:03:27.452655 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.452613    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07958720-e19a-4054-90ae-0c0cd052f807" containerName="insights-gathering"
Oct 30 03:03:27.452655 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.452627    5068 cpu_manager.go:414] "containerMap: removing container" podUID="07c431ff-4edd-45b1-b72d-5c3d2b66bfdc" containerName="insights-gathering"
Oct 30 03:03:27.452655 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.452632    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07c431ff-4edd-45b1-b72d-5c3d2b66bfdc" containerName="insights-gathering"
Oct 30 03:03:27.452780 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.452715    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="07958720-e19a-4054-90ae-0c0cd052f807" containerName="insights-gathering"
Oct 30 03:03:27.452780 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.452723    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="07c431ff-4edd-45b1-b72d-5c3d2b66bfdc" containerName="insights-gathering"
Oct 30 03:03:27.455638 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.455617    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-59b8df5579-pc8sk"
Oct 30 03:03:27.477476 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.477443    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-59b8df5579-pc8sk"]
Oct 30 03:03:27.503643 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.503600    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz9qc\" (UniqueName: \"kubernetes.io/projected/0846bd81-e145-4b13-b48c-376be87c5f4e-kube-api-access-xz9qc\") pod \"llmisvc-controller-manager-59b8df5579-pc8sk\" (UID: \"0846bd81-e145-4b13-b48c-376be87c5f4e\") " pod="kserve/llmisvc-controller-manager-59b8df5579-pc8sk"
Oct 30 03:03:27.503848 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.503788    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0846bd81-e145-4b13-b48c-376be87c5f4e-cert\") pod \"llmisvc-controller-manager-59b8df5579-pc8sk\" (UID: \"0846bd81-e145-4b13-b48c-376be87c5f4e\") " pod="kserve/llmisvc-controller-manager-59b8df5579-pc8sk"
Oct 30 03:03:27.548221 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.548184    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Oct 30 03:03:27.548221 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.548208    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-j7lbp\""
Oct 30 03:03:27.548405 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.548205    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Oct 30 03:03:27.548933 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.548917    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Oct 30 03:03:27.572976 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.572945    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:03:27.605149 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.605123    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0846bd81-e145-4b13-b48c-376be87c5f4e-cert\") pod \"llmisvc-controller-manager-59b8df5579-pc8sk\" (UID: \"0846bd81-e145-4b13-b48c-376be87c5f4e\") " pod="kserve/llmisvc-controller-manager-59b8df5579-pc8sk"
Oct 30 03:03:27.605317 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.605171    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz9qc\" (UniqueName: \"kubernetes.io/projected/0846bd81-e145-4b13-b48c-376be87c5f4e-kube-api-access-xz9qc\") pod \"llmisvc-controller-manager-59b8df5579-pc8sk\" (UID: \"0846bd81-e145-4b13-b48c-376be87c5f4e\") " pod="kserve/llmisvc-controller-manager-59b8df5579-pc8sk"
Oct 30 03:03:27.607645 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.607621    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0846bd81-e145-4b13-b48c-376be87c5f4e-cert\") pod \"llmisvc-controller-manager-59b8df5579-pc8sk\" (UID: \"0846bd81-e145-4b13-b48c-376be87c5f4e\") " pod="kserve/llmisvc-controller-manager-59b8df5579-pc8sk"
Oct 30 03:03:27.627292 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.627269    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz9qc\" (UniqueName: \"kubernetes.io/projected/0846bd81-e145-4b13-b48c-376be87c5f4e-kube-api-access-xz9qc\") pod \"llmisvc-controller-manager-59b8df5579-pc8sk\" (UID: \"0846bd81-e145-4b13-b48c-376be87c5f4e\") " pod="kserve/llmisvc-controller-manager-59b8df5579-pc8sk"
Oct 30 03:03:27.759643 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.759563    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:03:27.768501 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:27.768481    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-59b8df5579-pc8sk"
Oct 30 03:03:28.060094 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:28.060017    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-59b8df5579-pc8sk"]
Oct 30 03:03:28.065352 ip-10-0-139-40 kubenswrapper[5068]: W1030 03:03:28.065324    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0846bd81_e145_4b13_b48c_376be87c5f4e.slice/crio-0dcdc7fad1cf288d29629c8909988d37408de2e07db62e6061d42eb533d9acb0 WatchSource:0}: Error finding container 0dcdc7fad1cf288d29629c8909988d37408de2e07db62e6061d42eb533d9acb0: Status 404 returned error can't find the container with id 0dcdc7fad1cf288d29629c8909988d37408de2e07db62e6061d42eb533d9acb0
Oct 30 03:03:28.066669 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:28.066652    5068 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 03:03:28.795338 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:28.795301    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:03:28.968007 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:28.967927    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:03:28.975830 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:28.975746    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-59b8df5579-pc8sk" event={"ID":"0846bd81-e145-4b13-b48c-376be87c5f4e","Type":"ContainerStarted","Data":"0dcdc7fad1cf288d29629c8909988d37408de2e07db62e6061d42eb533d9acb0"}
Oct 30 03:03:29.144127 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:29.144060    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:03:30.984478 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:30.984445    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-59b8df5579-pc8sk" event={"ID":"0846bd81-e145-4b13-b48c-376be87c5f4e","Type":"ContainerStarted","Data":"eabf24b4fb8dc1cfb87adccbeee3d91b725b0dfdc80b71cf18572d4ae01a3b7f"}
Oct 30 03:03:30.984901 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:30.984698    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-59b8df5579-pc8sk"
Oct 30 03:03:31.022720 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:31.022656    5068 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-59b8df5579-pc8sk" podStartSLOduration=1.706553193 podStartE2EDuration="4.022643813s" totalImagesPullingTime="2.31609062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:03:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:03:31.022234693 +0000 UTC m=+468.097604905" watchObservedRunningTime="2026-10-30 03:03:31.022643813 +0000 UTC m=+468.098014023"
Oct 30 03:03:33.319507 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:33.319470    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:03:37.280590 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:03:37.280551    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:03:38.005137 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:03:38.005096    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:04:01.990880 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:04:01.990800    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-59b8df5579-pc8sk"
Oct 30 03:04:07.281475 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:04:07.281429    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:04:28.483591 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:04:28.483540    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:04:33.464522 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:04:33.464455    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:04:37.281830 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:04:37.281793    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:04:47.293215 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:04:47.293183    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:04:47.557189 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:04:47.557084    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:04:47.733290 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:04:47.733254    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:04:50.448639 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:04:50.448568    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:04:50.622828 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:04:50.622790    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:04:50.790980 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:04:50.790890    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:04:53.880862 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:04:53.880829    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:04:54.049311 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:04:54.049270    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:05:04.088370 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:05:04.088308    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:05:07.282573 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:05:07.282475    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:05:15.567825 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:05:15.567790    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:05:33.602933 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:05:33.602858    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:05:37.281483 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:05:37.281450    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:05:43.110820 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:05:43.110787    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/1.log"
Oct 30 03:05:43.112785 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:05:43.112746    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/1.log"
Oct 30 03:06:07.281373 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:06:07.281339    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:06:27.929022 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:27.928985    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:06:29.816446 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:29.816412    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:06:32.269066 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:32.269030    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:06:33.707408 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:33.707369    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:06:37.281111 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:06:37.281073    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:06:44.078493 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:44.078459    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:06:44.255402 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:44.255371    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:06:45.602326 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:45.602274    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:06:45.776569 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:45.776529    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:06:45.949838 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:45.949804    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:06:46.116203 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.116172    5068 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"]
Oct 30 03:06:46.119634 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.119612    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:06:46.125546 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.125506    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:06:46.137410 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.137387    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"isvc-canary-rollback-kube-rbac-proxy-sar-config\""
Oct 30 03:06:46.137496 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.137419    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"openshift-service-ca.crt\""
Oct 30 03:06:46.137496 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.137464    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 03:06:46.145789 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.145768    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a097932-1768-437c-97b9-177f9d840e99-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-598dbf8bc4-n486l\" (UID: \"9a097932-1768-437c-97b9-177f9d840e99\") " pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:06:46.145959 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.145930    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9a097932-1768-437c-97b9-177f9d840e99-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-598dbf8bc4-n486l\" (UID: \"9a097932-1768-437c-97b9-177f9d840e99\") " pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:06:46.146041 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.145980    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9a097932-1768-437c-97b9-177f9d840e99-cabundle-cert\") pod \"isvc-canary-rollback-predictor-598dbf8bc4-n486l\" (UID: \"9a097932-1768-437c-97b9-177f9d840e99\") " pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:06:46.146041 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.146025    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zsbr\" (UniqueName: \"kubernetes.io/projected/9a097932-1768-437c-97b9-177f9d840e99-kube-api-access-7zsbr\") pod \"isvc-canary-rollback-predictor-598dbf8bc4-n486l\" (UID: \"9a097932-1768-437c-97b9-177f9d840e99\") " pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:06:46.146145 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.146058    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a097932-1768-437c-97b9-177f9d840e99-proxy-tls\") pod \"isvc-canary-rollback-predictor-598dbf8bc4-n486l\" (UID: \"9a097932-1768-437c-97b9-177f9d840e99\") " pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:06:46.146589 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.146574    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"kube-root-ca.crt\""
Oct 30 03:06:46.147329 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.147305    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"isvc-canary-rollback-predictor-serving-cert\""
Oct 30 03:06:46.147439 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.147403    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"seaweedfs-s3-creds\""
Oct 30 03:06:46.147509 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.147439    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"default-dockercfg-57rzd\""
Oct 30 03:06:46.148743 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.148725    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"]
Oct 30 03:06:46.247227 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.247146    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9a097932-1768-437c-97b9-177f9d840e99-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-598dbf8bc4-n486l\" (UID: \"9a097932-1768-437c-97b9-177f9d840e99\") " pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:06:46.247227 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.247184    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9a097932-1768-437c-97b9-177f9d840e99-cabundle-cert\") pod \"isvc-canary-rollback-predictor-598dbf8bc4-n486l\" (UID: \"9a097932-1768-437c-97b9-177f9d840e99\") " pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:06:46.247470 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.247306    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zsbr\" (UniqueName: \"kubernetes.io/projected/9a097932-1768-437c-97b9-177f9d840e99-kube-api-access-7zsbr\") pod \"isvc-canary-rollback-predictor-598dbf8bc4-n486l\" (UID: \"9a097932-1768-437c-97b9-177f9d840e99\") " pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:06:46.247470 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.247349    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a097932-1768-437c-97b9-177f9d840e99-proxy-tls\") pod \"isvc-canary-rollback-predictor-598dbf8bc4-n486l\" (UID: \"9a097932-1768-437c-97b9-177f9d840e99\") " pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:06:46.247470 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.247405    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a097932-1768-437c-97b9-177f9d840e99-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-598dbf8bc4-n486l\" (UID: \"9a097932-1768-437c-97b9-177f9d840e99\") " pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:06:46.247852 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.247828    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a097932-1768-437c-97b9-177f9d840e99-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-598dbf8bc4-n486l\" (UID: \"9a097932-1768-437c-97b9-177f9d840e99\") " pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:06:46.247996 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.247932    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9a097932-1768-437c-97b9-177f9d840e99-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-598dbf8bc4-n486l\" (UID: \"9a097932-1768-437c-97b9-177f9d840e99\") " pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:06:46.248222 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.248203    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9a097932-1768-437c-97b9-177f9d840e99-cabundle-cert\") pod \"isvc-canary-rollback-predictor-598dbf8bc4-n486l\" (UID: \"9a097932-1768-437c-97b9-177f9d840e99\") " pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:06:46.249861 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.249836    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a097932-1768-437c-97b9-177f9d840e99-proxy-tls\") pod \"isvc-canary-rollback-predictor-598dbf8bc4-n486l\" (UID: \"9a097932-1768-437c-97b9-177f9d840e99\") " pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:06:46.269070 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.269043    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zsbr\" (UniqueName: \"kubernetes.io/projected/9a097932-1768-437c-97b9-177f9d840e99-kube-api-access-7zsbr\") pod \"isvc-canary-rollback-predictor-598dbf8bc4-n486l\" (UID: \"9a097932-1768-437c-97b9-177f9d840e99\") " pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:06:46.298905 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.298851    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:06:46.436034 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.436002    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:06:46.510210 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.510104    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:06:46.749534 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:46.749498    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"]
Oct 30 03:06:47.719412 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:47.719376    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" event={"ID":"9a097932-1768-437c-97b9-177f9d840e99","Type":"ContainerStarted","Data":"5effdfd7ed50ebdc35196d9e77c23364fbe0ea6b300a0e6e6d61d7904a3b7d1a"}
Oct 30 03:06:50.733573 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:50.733538    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" event={"ID":"9a097932-1768-437c-97b9-177f9d840e99","Type":"ContainerStarted","Data":"0315603e2465f037ec607e39414879a0dc25afe7d232c32bd50b525386b33c03"}
Oct 30 03:06:54.750303 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:54.750269    5068 generic.go:356] "Generic (PLEG): container finished" podID="9a097932-1768-437c-97b9-177f9d840e99" containerID="0315603e2465f037ec607e39414879a0dc25afe7d232c32bd50b525386b33c03" exitCode=0
Oct 30 03:06:54.750714 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:06:54.750343    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" event={"ID":"9a097932-1768-437c-97b9-177f9d840e99","Type":"ContainerDied","Data":"0315603e2465f037ec607e39414879a0dc25afe7d232c32bd50b525386b33c03"}
Oct 30 03:07:07.285853 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:07:07.285815    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:07:08.825483 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:07:08.825441    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" event={"ID":"9a097932-1768-437c-97b9-177f9d840e99","Type":"ContainerStarted","Data":"c437643b13c9eb8a44723cd6ab4b9275190529afd299f90fad3a997abf3494e3"}
Oct 30 03:07:10.836809 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:07:10.836767    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" event={"ID":"9a097932-1768-437c-97b9-177f9d840e99","Type":"ContainerStarted","Data":"ff73019028d84777a081a5674a355bb8eb38c24a9e071be3c46ec1ac0525e20a"}
Oct 30 03:07:10.837233 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:07:10.836959    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:07:10.888862 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:07:10.888819    5068 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" podStartSLOduration=2.119242837 podStartE2EDuration="24.888808241s" totalImagesPullingTime="18.841438397s" totalInitContainerRuntime="3.928127007s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:06:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:07:10.887534889 +0000 UTC m=+687.962905099" watchObservedRunningTime="2026-10-30 03:07:10.888808241 +0000 UTC m=+687.964178445"
Oct 30 03:07:11.841061 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:07:11.841029    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:07:11.842286 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:07:11.842248    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Oct 30 03:07:12.844884 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:07:12.844837    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Oct 30 03:07:17.849557 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:07:17.849530    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:07:17.850033 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:07:17.850004    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Oct 30 03:07:27.850840 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:07:27.850801    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Oct 30 03:07:27.922556 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:07:27.922519    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:07:33.842075 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:07:33.842039    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:07:37.281055 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:07:37.281022    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:07:37.850906 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:07:37.850870    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Oct 30 03:07:47.850760 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:07:47.850720    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Oct 30 03:07:57.850015 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:07:57.849974    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Oct 30 03:08:07.280836 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:08:07.280795    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:08:07.850051 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:08:07.850015    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Oct 30 03:08:17.850541 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:08:17.850502    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Oct 30 03:08:19.066951 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:08:19.066906    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Oct 30 03:08:29.070921 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:08:29.070847    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:08:33.960966 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:08:33.960934    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:08:37.281228 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:08:37.281193    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:08:51.027118 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:08:51.027080    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:08:51.716337 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:08:51.716303    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:09:07.282505 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:09:07.282469    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:09:23.387776 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.387735    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:09:23.462255 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.462224    5068 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"]
Oct 30 03:09:23.465810 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.465789    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:09:23.478920 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.478893    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-e6d7890379\"/\"isvc-sklearn-graph-raw-3299d-kube-rbac-proxy-sar-config\""
Oct 30 03:09:23.478920 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.478910    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-e6d7890379\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 03:09:23.488552 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.488534    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-e6d7890379\"/\"default-dockercfg-f9xch\""
Oct 30 03:09:23.488665 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.488561    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-e6d7890379\"/\"openshift-service-ca.crt\""
Oct 30 03:09:23.488665 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.488582    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-e6d7890379\"/\"seaweedfs-s3-creds\""
Oct 30 03:09:23.488665 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.488620    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-e6d7890379\"/\"kube-root-ca.crt\""
Oct 30 03:09:23.488811 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.488746    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-e6d7890379\"/\"isvc-sklearn-graph-raw-3299d-predictor-serving-cert\""
Oct 30 03:09:23.493532 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.493514    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"]
Oct 30 03:09:23.522435 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.522409    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/548d5251-cc35-4b92-beab-6c2f20c3f7af-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs\" (UID: \"548d5251-cc35-4b92-beab-6c2f20c3f7af\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:09:23.522542 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.522454    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbf8f\" (UniqueName: \"kubernetes.io/projected/548d5251-cc35-4b92-beab-6c2f20c3f7af-kube-api-access-qbf8f\") pod \"isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs\" (UID: \"548d5251-cc35-4b92-beab-6c2f20c3f7af\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:09:23.522542 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.522477    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/548d5251-cc35-4b92-beab-6c2f20c3f7af-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs\" (UID: \"548d5251-cc35-4b92-beab-6c2f20c3f7af\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:09:23.522614 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.522595    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/548d5251-cc35-4b92-beab-6c2f20c3f7af-proxy-tls\") pod \"isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs\" (UID: \"548d5251-cc35-4b92-beab-6c2f20c3f7af\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:09:23.522648 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.522628    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/548d5251-cc35-4b92-beab-6c2f20c3f7af-cabundle-cert\") pod \"isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs\" (UID: \"548d5251-cc35-4b92-beab-6c2f20c3f7af\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:09:23.557420 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.557391    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:09:23.623747 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.623722    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbf8f\" (UniqueName: \"kubernetes.io/projected/548d5251-cc35-4b92-beab-6c2f20c3f7af-kube-api-access-qbf8f\") pod \"isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs\" (UID: \"548d5251-cc35-4b92-beab-6c2f20c3f7af\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:09:23.623860 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.623752    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/548d5251-cc35-4b92-beab-6c2f20c3f7af-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs\" (UID: \"548d5251-cc35-4b92-beab-6c2f20c3f7af\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:09:23.623860 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.623776    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/548d5251-cc35-4b92-beab-6c2f20c3f7af-proxy-tls\") pod \"isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs\" (UID: \"548d5251-cc35-4b92-beab-6c2f20c3f7af\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:09:23.623860 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.623798    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/548d5251-cc35-4b92-beab-6c2f20c3f7af-cabundle-cert\") pod \"isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs\" (UID: \"548d5251-cc35-4b92-beab-6c2f20c3f7af\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:09:23.623860 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.623830    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/548d5251-cc35-4b92-beab-6c2f20c3f7af-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs\" (UID: \"548d5251-cc35-4b92-beab-6c2f20c3f7af\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:09:23.624176 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.624156    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/548d5251-cc35-4b92-beab-6c2f20c3f7af-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs\" (UID: \"548d5251-cc35-4b92-beab-6c2f20c3f7af\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:09:23.624547 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.624526    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/548d5251-cc35-4b92-beab-6c2f20c3f7af-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs\" (UID: \"548d5251-cc35-4b92-beab-6c2f20c3f7af\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:09:23.624609 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.624529    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/548d5251-cc35-4b92-beab-6c2f20c3f7af-cabundle-cert\") pod \"isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs\" (UID: \"548d5251-cc35-4b92-beab-6c2f20c3f7af\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:09:23.626182 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.626163    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/548d5251-cc35-4b92-beab-6c2f20c3f7af-proxy-tls\") pod \"isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs\" (UID: \"548d5251-cc35-4b92-beab-6c2f20c3f7af\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:09:23.647630 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.647571    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbf8f\" (UniqueName: \"kubernetes.io/projected/548d5251-cc35-4b92-beab-6c2f20c3f7af-kube-api-access-qbf8f\") pod \"isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs\" (UID: \"548d5251-cc35-4b92-beab-6c2f20c3f7af\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:09:23.782847 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.782814    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:09:23.787634 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.787590    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:09:23.957715 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:23.957618    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:09:24.093932 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:24.093901    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"]
Oct 30 03:09:24.100125 ip-10-0-139-40 kubenswrapper[5068]: W1030 03:09:24.100094    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod548d5251_cc35_4b92_beab_6c2f20c3f7af.slice/crio-7b11553396ee0ab5e240ee5d78c4f1a9ada0767708f1b0786cbbef61d1c69f46 WatchSource:0}: Error finding container 7b11553396ee0ab5e240ee5d78c4f1a9ada0767708f1b0786cbbef61d1c69f46: Status 404 returned error can't find the container with id 7b11553396ee0ab5e240ee5d78c4f1a9ada0767708f1b0786cbbef61d1c69f46
Oct 30 03:09:24.357416 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:24.357324    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" event={"ID":"548d5251-cc35-4b92-beab-6c2f20c3f7af","Type":"ContainerStarted","Data":"5c7a17ffbcdbc83372700598ba5aa6fc0d8d1c9d94a83b7bf70295db5de01cf0"}
Oct 30 03:09:24.357416 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:24.357386    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" event={"ID":"548d5251-cc35-4b92-beab-6c2f20c3f7af","Type":"ContainerStarted","Data":"7b11553396ee0ab5e240ee5d78c4f1a9ada0767708f1b0786cbbef61d1c69f46"}
Oct 30 03:09:28.377779 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:28.377746    5068 generic.go:356] "Generic (PLEG): container finished" podID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerID="5c7a17ffbcdbc83372700598ba5aa6fc0d8d1c9d94a83b7bf70295db5de01cf0" exitCode=0
Oct 30 03:09:28.378285 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:28.377802    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" event={"ID":"548d5251-cc35-4b92-beab-6c2f20c3f7af","Type":"ContainerDied","Data":"5c7a17ffbcdbc83372700598ba5aa6fc0d8d1c9d94a83b7bf70295db5de01cf0"}
Oct 30 03:09:29.383584 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:29.383549    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" event={"ID":"548d5251-cc35-4b92-beab-6c2f20c3f7af","Type":"ContainerStarted","Data":"6b98b7f7e1bc6016245e0b8174a915420f795f197d78b66ef4bdda12a182ea5c"}
Oct 30 03:09:29.384032 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:29.383609    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" event={"ID":"548d5251-cc35-4b92-beab-6c2f20c3f7af","Type":"ContainerStarted","Data":"d4c78f9f1d5f411808a1c09673d8a649676b8ea338029b041f677c3b119a3c2b"}
Oct 30 03:09:29.384032 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:29.383898    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:09:29.384115 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:29.384036    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:09:29.385048 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:29.385028    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Oct 30 03:09:29.435842 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:29.435755    5068 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" podStartSLOduration=2.764738617 podStartE2EDuration="6.435741913s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.671003296s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:09:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:09:29.433975871 +0000 UTC m=+826.509346078" watchObservedRunningTime="2026-10-30 03:09:29.435741913 +0000 UTC m=+826.511112181"
Oct 30 03:09:30.388264 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:30.388223    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Oct 30 03:09:34.249376 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:34.249314    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:09:35.392408 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:35.392376    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:09:35.392922 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:35.392893    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Oct 30 03:09:37.281026 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:09:37.280989    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:09:45.392935 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:45.392899    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Oct 30 03:09:55.393418 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:09:55.393334    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Oct 30 03:10:05.393096 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:05.393055    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Oct 30 03:10:07.281216 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:10:07.281175    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:10:15.393231 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:15.393192    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Oct 30 03:10:21.302654 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:21.302621    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"]
Oct 30 03:10:21.303100 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:21.302892    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="kserve-container" containerID="cri-o://c437643b13c9eb8a44723cd6ab4b9275190529afd299f90fad3a997abf3494e3" gracePeriod=30
Oct 30 03:10:21.303100 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:21.302942    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="kube-rbac-proxy" containerID="cri-o://ff73019028d84777a081a5674a355bb8eb38c24a9e071be3c46ec1ac0525e20a" gracePeriod=30
Oct 30 03:10:21.417228 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:21.417185    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:10:21.596034 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:21.595958    5068 generic.go:356] "Generic (PLEG): container finished" podID="9a097932-1768-437c-97b9-177f9d840e99" containerID="ff73019028d84777a081a5674a355bb8eb38c24a9e071be3c46ec1ac0525e20a" exitCode=0
Oct 30 03:10:21.596034 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:21.596022    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" event={"ID":"9a097932-1768-437c-97b9-177f9d840e99","Type":"ContainerDied","Data":"ff73019028d84777a081a5674a355bb8eb38c24a9e071be3c46ec1ac0525e20a"}
Oct 30 03:10:22.845323 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:22.845281    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.30:8643/healthz\": dial tcp 10.132.0.30:8643: connect: connection refused"
Oct 30 03:10:25.393284 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:25.393245    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Oct 30 03:10:25.951406 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:25.951382    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:10:26.006460 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.006392    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9a097932-1768-437c-97b9-177f9d840e99-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9a097932-1768-437c-97b9-177f9d840e99-cabundle-cert\") pod \"9a097932-1768-437c-97b9-177f9d840e99\" (UID: \"9a097932-1768-437c-97b9-177f9d840e99\") "
Oct 30 03:10:26.006460 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.006433    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a097932-1768-437c-97b9-177f9d840e99-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a097932-1768-437c-97b9-177f9d840e99-kserve-provision-location\") pod \"9a097932-1768-437c-97b9-177f9d840e99\" (UID: \"9a097932-1768-437c-97b9-177f9d840e99\") "
Oct 30 03:10:26.006653 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.006468    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9a097932-1768-437c-97b9-177f9d840e99-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9a097932-1768-437c-97b9-177f9d840e99-kube-rbac-proxy-sar-config\") pod \"9a097932-1768-437c-97b9-177f9d840e99\" (UID: \"9a097932-1768-437c-97b9-177f9d840e99\") "
Oct 30 03:10:26.006653 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.006496    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9a097932-1768-437c-97b9-177f9d840e99-proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a097932-1768-437c-97b9-177f9d840e99-proxy-tls\") pod \"9a097932-1768-437c-97b9-177f9d840e99\" (UID: \"9a097932-1768-437c-97b9-177f9d840e99\") "
Oct 30 03:10:26.006653 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.006542    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9a097932-1768-437c-97b9-177f9d840e99-kube-api-access-7zsbr\" (UniqueName: \"kubernetes.io/projected/9a097932-1768-437c-97b9-177f9d840e99-kube-api-access-7zsbr\") pod \"9a097932-1768-437c-97b9-177f9d840e99\" (UID: \"9a097932-1768-437c-97b9-177f9d840e99\") "
Oct 30 03:10:26.006828 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.006794    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a097932-1768-437c-97b9-177f9d840e99-kserve-provision-location" pod "9a097932-1768-437c-97b9-177f9d840e99" (UID: "9a097932-1768-437c-97b9-177f9d840e99"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:10:26.006884 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.006841    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a097932-1768-437c-97b9-177f9d840e99-kube-rbac-proxy-sar-config" pod "9a097932-1768-437c-97b9-177f9d840e99" (UID: "9a097932-1768-437c-97b9-177f9d840e99"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:10:26.006884 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.006847    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a097932-1768-437c-97b9-177f9d840e99-cabundle-cert" pod "9a097932-1768-437c-97b9-177f9d840e99" (UID: "9a097932-1768-437c-97b9-177f9d840e99"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:10:26.008829 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.008794    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a097932-1768-437c-97b9-177f9d840e99-proxy-tls" pod "9a097932-1768-437c-97b9-177f9d840e99" (UID: "9a097932-1768-437c-97b9-177f9d840e99"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:10:26.008960 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.008886    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a097932-1768-437c-97b9-177f9d840e99-kube-api-access-7zsbr" pod "9a097932-1768-437c-97b9-177f9d840e99" (UID: "9a097932-1768-437c-97b9-177f9d840e99"). InnerVolumeSpecName "kube-api-access-7zsbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:10:26.107347 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.107301    5068 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a097932-1768-437c-97b9-177f9d840e99-kserve-provision-location\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:10:26.107347 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.107340    5068 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9a097932-1768-437c-97b9-177f9d840e99-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:10:26.107347 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.107350    5068 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a097932-1768-437c-97b9-177f9d840e99-proxy-tls\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:10:26.107347 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.107362    5068 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zsbr\" (UniqueName: \"kubernetes.io/projected/9a097932-1768-437c-97b9-177f9d840e99-kube-api-access-7zsbr\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:10:26.107596 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.107371    5068 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9a097932-1768-437c-97b9-177f9d840e99-cabundle-cert\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:10:26.619015 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.618977    5068 generic.go:356] "Generic (PLEG): container finished" podID="9a097932-1768-437c-97b9-177f9d840e99" containerID="c437643b13c9eb8a44723cd6ab4b9275190529afd299f90fad3a997abf3494e3" exitCode=0
Oct 30 03:10:26.619539 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.619022    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" event={"ID":"9a097932-1768-437c-97b9-177f9d840e99","Type":"ContainerDied","Data":"c437643b13c9eb8a44723cd6ab4b9275190529afd299f90fad3a997abf3494e3"}
Oct 30 03:10:26.619539 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.619042    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"
Oct 30 03:10:26.619539 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.619068    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l" event={"ID":"9a097932-1768-437c-97b9-177f9d840e99","Type":"ContainerDied","Data":"5effdfd7ed50ebdc35196d9e77c23364fbe0ea6b300a0e6e6d61d7904a3b7d1a"}
Oct 30 03:10:26.619539 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.619095    5068 scope.go:122] "RemoveContainer" containerID="ff73019028d84777a081a5674a355bb8eb38c24a9e071be3c46ec1ac0525e20a"
Oct 30 03:10:26.627585 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.627569    5068 scope.go:122] "RemoveContainer" containerID="c437643b13c9eb8a44723cd6ab4b9275190529afd299f90fad3a997abf3494e3"
Oct 30 03:10:26.634661 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.634643    5068 scope.go:122] "RemoveContainer" containerID="0315603e2465f037ec607e39414879a0dc25afe7d232c32bd50b525386b33c03"
Oct 30 03:10:26.642564 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.642542    5068 scope.go:122] "RemoveContainer" containerID="ff73019028d84777a081a5674a355bb8eb38c24a9e071be3c46ec1ac0525e20a"
Oct 30 03:10:26.642833 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:10:26.642813    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff73019028d84777a081a5674a355bb8eb38c24a9e071be3c46ec1ac0525e20a\": container with ID starting with ff73019028d84777a081a5674a355bb8eb38c24a9e071be3c46ec1ac0525e20a not found: ID does not exist" containerID="ff73019028d84777a081a5674a355bb8eb38c24a9e071be3c46ec1ac0525e20a"
Oct 30 03:10:26.642890 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.642840    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff73019028d84777a081a5674a355bb8eb38c24a9e071be3c46ec1ac0525e20a"} err="failed to get container status \"ff73019028d84777a081a5674a355bb8eb38c24a9e071be3c46ec1ac0525e20a\": rpc error: code = NotFound desc = could not find container \"ff73019028d84777a081a5674a355bb8eb38c24a9e071be3c46ec1ac0525e20a\": container with ID starting with ff73019028d84777a081a5674a355bb8eb38c24a9e071be3c46ec1ac0525e20a not found: ID does not exist"
Oct 30 03:10:26.642890 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.642857    5068 scope.go:122] "RemoveContainer" containerID="c437643b13c9eb8a44723cd6ab4b9275190529afd299f90fad3a997abf3494e3"
Oct 30 03:10:26.643076 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:10:26.643058    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c437643b13c9eb8a44723cd6ab4b9275190529afd299f90fad3a997abf3494e3\": container with ID starting with c437643b13c9eb8a44723cd6ab4b9275190529afd299f90fad3a997abf3494e3 not found: ID does not exist" containerID="c437643b13c9eb8a44723cd6ab4b9275190529afd299f90fad3a997abf3494e3"
Oct 30 03:10:26.643118 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.643082    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c437643b13c9eb8a44723cd6ab4b9275190529afd299f90fad3a997abf3494e3"} err="failed to get container status \"c437643b13c9eb8a44723cd6ab4b9275190529afd299f90fad3a997abf3494e3\": rpc error: code = NotFound desc = could not find container \"c437643b13c9eb8a44723cd6ab4b9275190529afd299f90fad3a997abf3494e3\": container with ID starting with c437643b13c9eb8a44723cd6ab4b9275190529afd299f90fad3a997abf3494e3 not found: ID does not exist"
Oct 30 03:10:26.643118 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.643096    5068 scope.go:122] "RemoveContainer" containerID="0315603e2465f037ec607e39414879a0dc25afe7d232c32bd50b525386b33c03"
Oct 30 03:10:26.643326 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:10:26.643311    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0315603e2465f037ec607e39414879a0dc25afe7d232c32bd50b525386b33c03\": container with ID starting with 0315603e2465f037ec607e39414879a0dc25afe7d232c32bd50b525386b33c03 not found: ID does not exist" containerID="0315603e2465f037ec607e39414879a0dc25afe7d232c32bd50b525386b33c03"
Oct 30 03:10:26.643366 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.643329    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0315603e2465f037ec607e39414879a0dc25afe7d232c32bd50b525386b33c03"} err="failed to get container status \"0315603e2465f037ec607e39414879a0dc25afe7d232c32bd50b525386b33c03\": rpc error: code = NotFound desc = could not find container \"0315603e2465f037ec607e39414879a0dc25afe7d232c32bd50b525386b33c03\": container with ID starting with 0315603e2465f037ec607e39414879a0dc25afe7d232c32bd50b525386b33c03 not found: ID does not exist"
Oct 30 03:10:26.675507 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.675483    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"]
Oct 30 03:10:26.678577 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:26.678555    5068 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-rollback-predictor-598dbf8bc4-n486l"]
Oct 30 03:10:27.070800 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:27.070729    5068 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9a097932-1768-437c-97b9-177f9d840e99" path="/var/lib/kubelet/pods/9a097932-1768-437c-97b9-177f9d840e99/volumes"
Oct 30 03:10:28.979892 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:28.979858    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:10:29.046960 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.046932    5068 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"]
Oct 30 03:10:29.047248 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.047236    5068 cpu_manager.go:414] "containerMap: removing container" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="kube-rbac-proxy"
Oct 30 03:10:29.047300 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.047249    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="kube-rbac-proxy"
Oct 30 03:10:29.047300 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.047269    5068 cpu_manager.go:414] "containerMap: removing container" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="kserve-container"
Oct 30 03:10:29.047300 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.047276    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="kserve-container"
Oct 30 03:10:29.047300 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.047290    5068 cpu_manager.go:414] "containerMap: removing container" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="storage-initializer"
Oct 30 03:10:29.047300 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.047296    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="storage-initializer"
Oct 30 03:10:29.047470 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.047347    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="kube-rbac-proxy"
Oct 30 03:10:29.047470 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.047357    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="9a097932-1768-437c-97b9-177f9d840e99" containerName="kserve-container"
Oct 30 03:10:29.052970 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.052116    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:10:29.070263 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.070237    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"kube-root-ca.crt\""
Oct 30 03:10:29.070402 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.070309    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"seaweedfs-s3-creds\""
Oct 30 03:10:29.076932 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.076904    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"openshift-service-ca.crt\""
Oct 30 03:10:29.077033 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.076999    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"isvc-canary-stop-v2-predictor-serving-cert\""
Oct 30 03:10:29.077087 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.077038    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 03:10:29.077087 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.077050    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"default-dockercfg-57rzd\""
Oct 30 03:10:29.081520 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.081498    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"]
Oct 30 03:10:29.128462 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.128432    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kserve-provision-location\") pod \"isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql\" (UID: \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:10:29.128612 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.128477    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql\" (UID: \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:10:29.128612 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.128514    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcpgw\" (UniqueName: \"kubernetes.io/projected/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kube-api-access-rcpgw\") pod \"isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql\" (UID: \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:10:29.128736 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.128651    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-cabundle-cert\") pod \"isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql\" (UID: \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:10:29.128736 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.128681    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-proxy-tls\") pod \"isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql\" (UID: \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:10:29.153106 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.153076    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:10:29.167312 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.167293    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"isvc-canary-stop-kube-rbac-proxy-sar-config\""
Oct 30 03:10:29.230158 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.230073    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kserve-provision-location\") pod \"isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql\" (UID: \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:10:29.230158 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.230135    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql\" (UID: \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:10:29.230333 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.230183    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcpgw\" (UniqueName: \"kubernetes.io/projected/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kube-api-access-rcpgw\") pod \"isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql\" (UID: \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:10:29.230333 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.230213    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-cabundle-cert\") pod \"isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql\" (UID: \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:10:29.230333 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.230249    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-proxy-tls\") pod \"isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql\" (UID: \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:10:29.230519 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.230496    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kserve-provision-location\") pod \"isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql\" (UID: \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:10:29.230950 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.230926    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql\" (UID: \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:10:29.231015 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.230932    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-cabundle-cert\") pod \"isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql\" (UID: \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:10:29.232640 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.232618    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-proxy-tls\") pod \"isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql\" (UID: \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:10:29.251501 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.251479    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcpgw\" (UniqueName: \"kubernetes.io/projected/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kube-api-access-rcpgw\") pod \"isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql\" (UID: \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:10:29.318373 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.318343    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:10:29.350717 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.350674    5068 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"]
Oct 30 03:10:29.354769 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.354751    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:10:29.368329 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.368294    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"isvc-canary-stop-predictor-serving-cert\""
Oct 30 03:10:29.372452 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.372422    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:10:29.378798 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.378752    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"]
Oct 30 03:10:29.432455 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.432252    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kserve-provision-location\") pod \"isvc-canary-stop-predictor-94cccdcc4-wfz95\" (UID: \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:10:29.432455 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.432327    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-94cccdcc4-wfz95\" (UID: \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:10:29.432455 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.432383    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqdmw\" (UniqueName: \"kubernetes.io/projected/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kube-api-access-dqdmw\") pod \"isvc-canary-stop-predictor-94cccdcc4-wfz95\" (UID: \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:10:29.432455 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.432409    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-cabundle-cert\") pod \"isvc-canary-stop-predictor-94cccdcc4-wfz95\" (UID: \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:10:29.432779 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.432490    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-proxy-tls\") pod \"isvc-canary-stop-predictor-94cccdcc4-wfz95\" (UID: \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:10:29.533895 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.533812    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kserve-provision-location\") pod \"isvc-canary-stop-predictor-94cccdcc4-wfz95\" (UID: \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:10:29.533895 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.533868    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-94cccdcc4-wfz95\" (UID: \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:10:29.534108 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.533921    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqdmw\" (UniqueName: \"kubernetes.io/projected/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kube-api-access-dqdmw\") pod \"isvc-canary-stop-predictor-94cccdcc4-wfz95\" (UID: \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:10:29.534108 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.533948    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-cabundle-cert\") pod \"isvc-canary-stop-predictor-94cccdcc4-wfz95\" (UID: \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:10:29.534108 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.533982    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-proxy-tls\") pod \"isvc-canary-stop-predictor-94cccdcc4-wfz95\" (UID: \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:10:29.534333 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.534304    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kserve-provision-location\") pod \"isvc-canary-stop-predictor-94cccdcc4-wfz95\" (UID: \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:10:29.534748 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.534710    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-94cccdcc4-wfz95\" (UID: \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:10:29.534854 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.534722    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-cabundle-cert\") pod \"isvc-canary-stop-predictor-94cccdcc4-wfz95\" (UID: \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:10:29.536364 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.536344    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-proxy-tls\") pod \"isvc-canary-stop-predictor-94cccdcc4-wfz95\" (UID: \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:10:29.556017 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.555996    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqdmw\" (UniqueName: \"kubernetes.io/projected/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kube-api-access-dqdmw\") pod \"isvc-canary-stop-predictor-94cccdcc4-wfz95\" (UID: \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:10:29.671921 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.671891    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:10:29.684137 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.684116    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"]
Oct 30 03:10:29.689128 ip-10-0-139-40 kubenswrapper[5068]: W1030 03:10:29.689097    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca48d4b5_77a5_46c9_ab0a_715068e2bb98.slice/crio-fd8b48ce45f8153eb70f4e468f00f38240a60371975d39fe9b812af04fe6c94f WatchSource:0}: Error finding container fd8b48ce45f8153eb70f4e468f00f38240a60371975d39fe9b812af04fe6c94f: Status 404 returned error can't find the container with id fd8b48ce45f8153eb70f4e468f00f38240a60371975d39fe9b812af04fe6c94f
Oct 30 03:10:29.747096 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.747066    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:10:29.990022 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:29.989987    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"]
Oct 30 03:10:29.995548 ip-10-0-139-40 kubenswrapper[5068]: W1030 03:10:29.995517    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f99e38b_cbc2_4e21_ba33_43f4a4ddc04d.slice/crio-037992d9ab8ada073e93148f363a9807691e402e1686c542cb4ecc6047ef68ef WatchSource:0}: Error finding container 037992d9ab8ada073e93148f363a9807691e402e1686c542cb4ecc6047ef68ef: Status 404 returned error can't find the container with id 037992d9ab8ada073e93148f363a9807691e402e1686c542cb4ecc6047ef68ef
Oct 30 03:10:30.638555 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:30.638515    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" event={"ID":"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d","Type":"ContainerStarted","Data":"06d070dc144a96e476071ed4b3bac28f1c8b29d34a514324dd7bc437e89787f9"}
Oct 30 03:10:30.638762 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:30.638582    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" event={"ID":"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d","Type":"ContainerStarted","Data":"037992d9ab8ada073e93148f363a9807691e402e1686c542cb4ecc6047ef68ef"}
Oct 30 03:10:30.640192 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:30.640162    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" event={"ID":"ca48d4b5-77a5-46c9-ab0a-715068e2bb98","Type":"ContainerStarted","Data":"aaeca2a10d76d7a3c333d8dfb34082b8489cdb22ad9a91a859d84c41f784b8db"}
Oct 30 03:10:30.640305 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:30.640231    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" event={"ID":"ca48d4b5-77a5-46c9-ab0a-715068e2bb98","Type":"ContainerStarted","Data":"fd8b48ce45f8153eb70f4e468f00f38240a60371975d39fe9b812af04fe6c94f"}
Oct 30 03:10:34.233291 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:34.233249    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:10:34.659460 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:34.659426    5068 generic.go:356] "Generic (PLEG): container finished" podID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerID="06d070dc144a96e476071ed4b3bac28f1c8b29d34a514324dd7bc437e89787f9" exitCode=0
Oct 30 03:10:34.659624 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:34.659495    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" event={"ID":"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d","Type":"ContainerDied","Data":"06d070dc144a96e476071ed4b3bac28f1c8b29d34a514324dd7bc437e89787f9"}
Oct 30 03:10:34.661169 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:34.661149    5068 generic.go:356] "Generic (PLEG): container finished" podID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerID="aaeca2a10d76d7a3c333d8dfb34082b8489cdb22ad9a91a859d84c41f784b8db" exitCode=0
Oct 30 03:10:34.661273 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:34.661176    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" event={"ID":"ca48d4b5-77a5-46c9-ab0a-715068e2bb98","Type":"ContainerDied","Data":"aaeca2a10d76d7a3c333d8dfb34082b8489cdb22ad9a91a859d84c41f784b8db"}
Oct 30 03:10:35.393542 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:35.393503    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Oct 30 03:10:35.667726 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:35.667625    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" event={"ID":"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d","Type":"ContainerStarted","Data":"522e46008a772a776aa4c016401c909cde83bb1bdaa3de10bf96b78350200ab6"}
Oct 30 03:10:35.667726 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:35.667705    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" event={"ID":"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d","Type":"ContainerStarted","Data":"2c0da0d63ca414aae7907d1874a6ad2cbd888d1d4cf6b109ef86530db7ed2c51"}
Oct 30 03:10:35.667949 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:35.667897    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:10:35.669728 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:35.669703    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" event={"ID":"ca48d4b5-77a5-46c9-ab0a-715068e2bb98","Type":"ContainerStarted","Data":"ef4602e8e4a83e3d3fb192238ce1e2ce1bcab34d0ea14402009c895b3f4c8833"}
Oct 30 03:10:35.669838 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:35.669745    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" event={"ID":"ca48d4b5-77a5-46c9-ab0a-715068e2bb98","Type":"ContainerStarted","Data":"ec803cf99e2251730727ccb808b274cf2f7f47ce4d0ecb024faf6af9b58d3f7f"}
Oct 30 03:10:35.669933 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:35.669917    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:10:35.718186 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:35.718146    5068 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" podStartSLOduration=2.823214005 podStartE2EDuration="6.718135529s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.894921524s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:10:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:10:35.717440241 +0000 UTC m=+892.792810451" watchObservedRunningTime="2026-10-30 03:10:35.718135529 +0000 UTC m=+892.793505736"
Oct 30 03:10:35.759157 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:35.759119    5068 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" podStartSLOduration=2.752691053 podStartE2EDuration="6.759108212s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.006417159s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:10:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:10:35.757545664 +0000 UTC m=+892.832915875" watchObservedRunningTime="2026-10-30 03:10:35.759108212 +0000 UTC m=+892.834478423"
Oct 30 03:10:36.675156 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:36.675122    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:10:36.675543 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:36.675192    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:10:36.676202 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:36.676177    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Oct 30 03:10:36.676244 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:36.676177    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Oct 30 03:10:37.281252 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:10:37.281213    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:10:37.678980 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:37.678943    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Oct 30 03:10:37.679366 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:37.679067    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Oct 30 03:10:42.683222 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:42.683189    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:10:42.683736 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:42.683592    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:10:42.683736 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:42.683652    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Oct 30 03:10:42.684068 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:42.684047    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Oct 30 03:10:43.138805 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:43.138778    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/1.log"
Oct 30 03:10:43.140536 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:43.140512    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/1.log"
Oct 30 03:10:45.393792 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:45.393761    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:10:52.683720 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:52.683663    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Oct 30 03:10:52.684114 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:10:52.683983    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Oct 30 03:11:02.683899 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:02.683840    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Oct 30 03:11:02.684471 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:02.683988    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Oct 30 03:11:03.620809 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:03.620767    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:11:03.796353 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:03.796321    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:11:07.286539 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:11:07.286505    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:11:12.683652 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:12.683611    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Oct 30 03:11:12.684070 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:12.684054    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Oct 30 03:11:14.066940 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:14.066902    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"]
Oct 30 03:11:14.067400 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:14.067184    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="kserve-container" containerID="cri-o://d4c78f9f1d5f411808a1c09673d8a649676b8ea338029b041f677c3b119a3c2b" gracePeriod=30
Oct 30 03:11:14.067400 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:14.067273    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="kube-rbac-proxy" containerID="cri-o://6b98b7f7e1bc6016245e0b8174a915420f795f197d78b66ef4bdda12a182ea5c" gracePeriod=30
Oct 30 03:11:14.302452 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:14.302414    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:11:14.488733 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:14.488671    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:11:14.836503 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:14.836424    5068 generic.go:356] "Generic (PLEG): container finished" podID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerID="6b98b7f7e1bc6016245e0b8174a915420f795f197d78b66ef4bdda12a182ea5c" exitCode=0
Oct 30 03:11:14.836503 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:14.836495    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" event={"ID":"548d5251-cc35-4b92-beab-6c2f20c3f7af","Type":"ContainerDied","Data":"6b98b7f7e1bc6016245e0b8174a915420f795f197d78b66ef4bdda12a182ea5c"}
Oct 30 03:11:15.389324 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:15.389274    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.31:8643/healthz\": dial tcp 10.132.0.31:8643: connect: connection refused"
Oct 30 03:11:15.393625 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:15.393594    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Oct 30 03:11:18.854836 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:18.854797    5068 generic.go:356] "Generic (PLEG): container finished" podID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerID="d4c78f9f1d5f411808a1c09673d8a649676b8ea338029b041f677c3b119a3c2b" exitCode=0
Oct 30 03:11:18.855209 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:18.854878    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" event={"ID":"548d5251-cc35-4b92-beab-6c2f20c3f7af","Type":"ContainerDied","Data":"d4c78f9f1d5f411808a1c09673d8a649676b8ea338029b041f677c3b119a3c2b"}
Oct 30 03:11:18.907670 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:18.907649    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:11:19.024953 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.024880    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/548d5251-cc35-4b92-beab-6c2f20c3f7af-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/548d5251-cc35-4b92-beab-6c2f20c3f7af-cabundle-cert\") pod \"548d5251-cc35-4b92-beab-6c2f20c3f7af\" (UID: \"548d5251-cc35-4b92-beab-6c2f20c3f7af\") "
Oct 30 03:11:19.024953 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.024924    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/548d5251-cc35-4b92-beab-6c2f20c3f7af-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/548d5251-cc35-4b92-beab-6c2f20c3f7af-kserve-provision-location\") pod \"548d5251-cc35-4b92-beab-6c2f20c3f7af\" (UID: \"548d5251-cc35-4b92-beab-6c2f20c3f7af\") "
Oct 30 03:11:19.025173 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.024973    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/548d5251-cc35-4b92-beab-6c2f20c3f7af-kube-api-access-qbf8f\" (UniqueName: \"kubernetes.io/projected/548d5251-cc35-4b92-beab-6c2f20c3f7af-kube-api-access-qbf8f\") pod \"548d5251-cc35-4b92-beab-6c2f20c3f7af\" (UID: \"548d5251-cc35-4b92-beab-6c2f20c3f7af\") "
Oct 30 03:11:19.025173 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.025022    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/548d5251-cc35-4b92-beab-6c2f20c3f7af-proxy-tls\" (UniqueName: \"kubernetes.io/secret/548d5251-cc35-4b92-beab-6c2f20c3f7af-proxy-tls\") pod \"548d5251-cc35-4b92-beab-6c2f20c3f7af\" (UID: \"548d5251-cc35-4b92-beab-6c2f20c3f7af\") "
Oct 30 03:11:19.025173 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.025139    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/548d5251-cc35-4b92-beab-6c2f20c3f7af-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/548d5251-cc35-4b92-beab-6c2f20c3f7af-kube-rbac-proxy-sar-config\") pod \"548d5251-cc35-4b92-beab-6c2f20c3f7af\" (UID: \"548d5251-cc35-4b92-beab-6c2f20c3f7af\") "
Oct 30 03:11:19.025330 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.025267    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/548d5251-cc35-4b92-beab-6c2f20c3f7af-cabundle-cert" pod "548d5251-cc35-4b92-beab-6c2f20c3f7af" (UID: "548d5251-cc35-4b92-beab-6c2f20c3f7af"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:11:19.025424 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.025326    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/548d5251-cc35-4b92-beab-6c2f20c3f7af-kserve-provision-location" pod "548d5251-cc35-4b92-beab-6c2f20c3f7af" (UID: "548d5251-cc35-4b92-beab-6c2f20c3f7af"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:11:19.025520 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.025495    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/548d5251-cc35-4b92-beab-6c2f20c3f7af-kube-rbac-proxy-sar-config" pod "548d5251-cc35-4b92-beab-6c2f20c3f7af" (UID: "548d5251-cc35-4b92-beab-6c2f20c3f7af"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:11:19.025561 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.025546    5068 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/548d5251-cc35-4b92-beab-6c2f20c3f7af-cabundle-cert\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:11:19.025593 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.025560    5068 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/548d5251-cc35-4b92-beab-6c2f20c3f7af-kserve-provision-location\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:11:19.027411 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.027378    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/548d5251-cc35-4b92-beab-6c2f20c3f7af-kube-api-access-qbf8f" pod "548d5251-cc35-4b92-beab-6c2f20c3f7af" (UID: "548d5251-cc35-4b92-beab-6c2f20c3f7af"). InnerVolumeSpecName "kube-api-access-qbf8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:11:19.027535 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.027448    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/548d5251-cc35-4b92-beab-6c2f20c3f7af-proxy-tls" pod "548d5251-cc35-4b92-beab-6c2f20c3f7af" (UID: "548d5251-cc35-4b92-beab-6c2f20c3f7af"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:11:19.126877 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.126849    5068 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/548d5251-cc35-4b92-beab-6c2f20c3f7af-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:11:19.126989 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.126883    5068 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbf8f\" (UniqueName: \"kubernetes.io/projected/548d5251-cc35-4b92-beab-6c2f20c3f7af-kube-api-access-qbf8f\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:11:19.126989 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.126899    5068 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/548d5251-cc35-4b92-beab-6c2f20c3f7af-proxy-tls\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:11:19.861334 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.861307    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"
Oct 30 03:11:19.861750 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.861307    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs" event={"ID":"548d5251-cc35-4b92-beab-6c2f20c3f7af","Type":"ContainerDied","Data":"7b11553396ee0ab5e240ee5d78c4f1a9ada0767708f1b0786cbbef61d1c69f46"}
Oct 30 03:11:19.861750 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.861444    5068 scope.go:122] "RemoveContainer" containerID="6b98b7f7e1bc6016245e0b8174a915420f795f197d78b66ef4bdda12a182ea5c"
Oct 30 03:11:19.869621 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.869604    5068 scope.go:122] "RemoveContainer" containerID="d4c78f9f1d5f411808a1c09673d8a649676b8ea338029b041f677c3b119a3c2b"
Oct 30 03:11:19.877081 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.877060    5068 scope.go:122] "RemoveContainer" containerID="5c7a17ffbcdbc83372700598ba5aa6fc0d8d1c9d94a83b7bf70295db5de01cf0"
Oct 30 03:11:19.917922 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.917896    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"]
Oct 30 03:11:19.928577 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:19.928552    5068 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-e6d7890379/isvc-sklearn-graph-raw-3299d-predictor-8cc79dfc9-chvrs"]
Oct 30 03:11:21.071301 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:21.071268    5068 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" path="/var/lib/kubelet/pods/548d5251-cc35-4b92-beab-6c2f20c3f7af/volumes"
Oct 30 03:11:21.607368 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:21.607339    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:11:21.811487 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:21.811449    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:11:22.287555 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.287516    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:11:22.359214 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.359168    5068 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"]
Oct 30 03:11:22.359572 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.359554    5068 cpu_manager.go:414] "containerMap: removing container" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="kserve-container"
Oct 30 03:11:22.359644 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.359574    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="kserve-container"
Oct 30 03:11:22.359644 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.359603    5068 cpu_manager.go:414] "containerMap: removing container" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="kube-rbac-proxy"
Oct 30 03:11:22.359644 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.359611    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="kube-rbac-proxy"
Oct 30 03:11:22.359644 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.359627    5068 cpu_manager.go:414] "containerMap: removing container" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="storage-initializer"
Oct 30 03:11:22.359644 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.359636    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="storage-initializer"
Oct 30 03:11:22.359844 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.359757    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="kserve-container"
Oct 30 03:11:22.359844 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.359773    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="548d5251-cc35-4b92-beab-6c2f20c3f7af" containerName="kube-rbac-proxy"
Oct 30 03:11:22.364655 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.364635    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:11:22.381399 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.381379    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-e6d7890379\"/\"default-dockercfg-f9xch\""
Oct 30 03:11:22.381488 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.381427    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-e6d7890379\"/\"isvc-xgboost-graph-raw-hpa-fdaf1-kube-rbac-proxy-sar-config\""
Oct 30 03:11:22.381488 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.381448    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-e6d7890379\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 03:11:22.381488 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.381451    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-e6d7890379\"/\"kube-root-ca.crt\""
Oct 30 03:11:22.391178 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.391158    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-e6d7890379\"/\"seaweedfs-s3-creds\""
Oct 30 03:11:22.391275 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.391220    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-e6d7890379\"/\"isvc-xgboost-graph-raw-hpa-fdaf1-predictor-serving-cert\""
Oct 30 03:11:22.391446 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.391432    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-e6d7890379\"/\"openshift-service-ca.crt\""
Oct 30 03:11:22.394726 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.394706    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"]
Oct 30 03:11:22.456167 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.456132    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/86bcf91a-0769-4136-8610-960055ef9d30-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd\" (UID: \"86bcf91a-0769-4136-8610-960055ef9d30\") " pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:11:22.456167 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.456171    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxp6b\" (UniqueName: \"kubernetes.io/projected/86bcf91a-0769-4136-8610-960055ef9d30-kube-api-access-kxp6b\") pod \"isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd\" (UID: \"86bcf91a-0769-4136-8610-960055ef9d30\") " pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:11:22.456350 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.456247    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/86bcf91a-0769-4136-8610-960055ef9d30-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd\" (UID: \"86bcf91a-0769-4136-8610-960055ef9d30\") " pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:11:22.456350 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.456291    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/86bcf91a-0769-4136-8610-960055ef9d30-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd\" (UID: \"86bcf91a-0769-4136-8610-960055ef9d30\") " pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:11:22.456350 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.456329    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/86bcf91a-0769-4136-8610-960055ef9d30-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd\" (UID: \"86bcf91a-0769-4136-8610-960055ef9d30\") " pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:11:22.501504 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.501461    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:11:22.557382 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.557308    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/86bcf91a-0769-4136-8610-960055ef9d30-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd\" (UID: \"86bcf91a-0769-4136-8610-960055ef9d30\") " pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:11:22.557382 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.557352    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/86bcf91a-0769-4136-8610-960055ef9d30-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd\" (UID: \"86bcf91a-0769-4136-8610-960055ef9d30\") " pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:11:22.557542 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.557392    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/86bcf91a-0769-4136-8610-960055ef9d30-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd\" (UID: \"86bcf91a-0769-4136-8610-960055ef9d30\") " pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:11:22.557542 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.557418    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/86bcf91a-0769-4136-8610-960055ef9d30-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd\" (UID: \"86bcf91a-0769-4136-8610-960055ef9d30\") " pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:11:22.557542 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.557436    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxp6b\" (UniqueName: \"kubernetes.io/projected/86bcf91a-0769-4136-8610-960055ef9d30-kube-api-access-kxp6b\") pod \"isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd\" (UID: \"86bcf91a-0769-4136-8610-960055ef9d30\") " pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:11:22.557891 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.557871    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/86bcf91a-0769-4136-8610-960055ef9d30-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd\" (UID: \"86bcf91a-0769-4136-8610-960055ef9d30\") " pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:11:22.558272 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.558248    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/86bcf91a-0769-4136-8610-960055ef9d30-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd\" (UID: \"86bcf91a-0769-4136-8610-960055ef9d30\") " pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:11:22.558313 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.558248    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/86bcf91a-0769-4136-8610-960055ef9d30-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd\" (UID: \"86bcf91a-0769-4136-8610-960055ef9d30\") " pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:11:22.559731 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.559717    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/86bcf91a-0769-4136-8610-960055ef9d30-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd\" (UID: \"86bcf91a-0769-4136-8610-960055ef9d30\") " pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:11:22.579578 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.579557    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxp6b\" (UniqueName: \"kubernetes.io/projected/86bcf91a-0769-4136-8610-960055ef9d30-kube-api-access-kxp6b\") pod \"isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd\" (UID: \"86bcf91a-0769-4136-8610-960055ef9d30\") " pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:11:22.681167 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.681130    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:11:22.684126 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.684085    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Oct 30 03:11:22.684126 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.684110    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Oct 30 03:11:22.997874 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:22.997841    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"]
Oct 30 03:11:23.003138 ip-10-0-139-40 kubenswrapper[5068]: W1030 03:11:23.003109    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86bcf91a_0769_4136_8610_960055ef9d30.slice/crio-07f28c5c69afaa4a150f994f163ab2c203c4da67f6632d8e34e7e8008230d4b6 WatchSource:0}: Error finding container 07f28c5c69afaa4a150f994f163ab2c203c4da67f6632d8e34e7e8008230d4b6: Status 404 returned error can't find the container with id 07f28c5c69afaa4a150f994f163ab2c203c4da67f6632d8e34e7e8008230d4b6
Oct 30 03:11:23.879469 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:23.879434    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" event={"ID":"86bcf91a-0769-4136-8610-960055ef9d30","Type":"ContainerStarted","Data":"a376c21f325a13fd887c97d5ecd43b4396afa732b4ae3794e47c108dd6f39504"}
Oct 30 03:11:23.879838 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:23.879493    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" event={"ID":"86bcf91a-0769-4136-8610-960055ef9d30","Type":"ContainerStarted","Data":"07f28c5c69afaa4a150f994f163ab2c203c4da67f6632d8e34e7e8008230d4b6"}
Oct 30 03:11:26.891841 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:26.891809    5068 generic.go:356] "Generic (PLEG): container finished" podID="86bcf91a-0769-4136-8610-960055ef9d30" containerID="a376c21f325a13fd887c97d5ecd43b4396afa732b4ae3794e47c108dd6f39504" exitCode=0
Oct 30 03:11:26.892229 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:26.891863    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" event={"ID":"86bcf91a-0769-4136-8610-960055ef9d30","Type":"ContainerDied","Data":"a376c21f325a13fd887c97d5ecd43b4396afa732b4ae3794e47c108dd6f39504"}
Oct 30 03:11:26.893267 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:26.893245    5068 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 03:11:32.683659 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:32.683614    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Oct 30 03:11:32.684274 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:32.684063    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Oct 30 03:11:34.369286 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:34.369255    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:11:37.288906 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:11:37.288861    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:11:42.683631 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:42.683593    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Oct 30 03:11:42.684093 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:42.684053    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Oct 30 03:11:46.986863 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:46.986822    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" event={"ID":"86bcf91a-0769-4136-8610-960055ef9d30","Type":"ContainerStarted","Data":"618655d368a829b72073a0472dd6729108a8287e63901663d842506c4a15556b"}
Oct 30 03:11:46.987239 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:46.986884    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" event={"ID":"86bcf91a-0769-4136-8610-960055ef9d30","Type":"ContainerStarted","Data":"d6847838474058e324a1115b053abb497d285437f94f4dbc2b99736524ced57f"}
Oct 30 03:11:46.987239 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:46.987121    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:11:47.038650 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:47.038600    5068 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" podStartSLOduration=2.062105087 podStartE2EDuration="25.038588298s" totalImagesPullingTime="19.330505965s" totalInitContainerRuntime="3.645977246s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:11:47.037820516 +0000 UTC m=+964.113190726" watchObservedRunningTime="2026-10-30 03:11:47.038588298 +0000 UTC m=+964.113958511"
Oct 30 03:11:47.991388 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:47.991350    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:11:47.992776 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:47.992745    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" podUID="86bcf91a-0769-4136-8610-960055ef9d30" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Oct 30 03:11:48.997094 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:48.997044    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" podUID="86bcf91a-0769-4136-8610-960055ef9d30" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Oct 30 03:11:50.066700 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:50.066639    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Oct 30 03:11:52.684845 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:52.684807    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Oct 30 03:11:53.068571 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:53.068485    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Oct 30 03:11:54.001155 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:54.001126    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:11:54.001592 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:11:54.001565    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" podUID="86bcf91a-0769-4136-8610-960055ef9d30" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Oct 30 03:12:00.066858 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:00.066823    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:12:00.536761 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:00.536728    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"]
Oct 30 03:12:00.536998 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:00.536973    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="kserve-container" containerID="cri-o://2c0da0d63ca414aae7907d1874a6ad2cbd888d1d4cf6b109ef86530db7ed2c51" gracePeriod=30
Oct 30 03:12:00.537133 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:00.537063    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="kube-rbac-proxy" containerID="cri-o://522e46008a772a776aa4c016401c909cde83bb1bdaa3de10bf96b78350200ab6" gracePeriod=30
Oct 30 03:12:00.537928 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:00.537908    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:12:01.050337 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:01.050299    5068 generic.go:356] "Generic (PLEG): container finished" podID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerID="522e46008a772a776aa4c016401c909cde83bb1bdaa3de10bf96b78350200ab6" exitCode=0
Oct 30 03:12:01.050508 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:01.050367    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" event={"ID":"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d","Type":"ContainerDied","Data":"522e46008a772a776aa4c016401c909cde83bb1bdaa3de10bf96b78350200ab6"}
Oct 30 03:12:02.680042 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:02.680006    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.33:8643/healthz\": dial tcp 10.132.0.33:8643: connect: connection refused"
Oct 30 03:12:04.002476 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:04.002440    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" podUID="86bcf91a-0769-4136-8610-960055ef9d30" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Oct 30 03:12:05.069884 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:05.069849    5068 generic.go:356] "Generic (PLEG): container finished" podID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerID="2c0da0d63ca414aae7907d1874a6ad2cbd888d1d4cf6b109ef86530db7ed2c51" exitCode=0
Oct 30 03:12:05.071474 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:05.071448    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" event={"ID":"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d","Type":"ContainerDied","Data":"2c0da0d63ca414aae7907d1874a6ad2cbd888d1d4cf6b109ef86530db7ed2c51"}
Oct 30 03:12:05.090416 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:05.090395    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:12:05.184139 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:05.184113    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kube-api-access-dqdmw\" (UniqueName: \"kubernetes.io/projected/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kube-api-access-dqdmw\") pod \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\" (UID: \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\") "
Oct 30 03:12:05.184347 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:05.184168    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-proxy-tls\" (UniqueName: \"kubernetes.io/secret/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-proxy-tls\") pod \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\" (UID: \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\") "
Oct 30 03:12:05.184347 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:05.184205    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-cabundle-cert\") pod \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\" (UID: \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\") "
Oct 30 03:12:05.184347 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:05.184232    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kube-rbac-proxy-sar-config\") pod \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\" (UID: \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\") "
Oct 30 03:12:05.184347 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:05.184251    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kserve-provision-location\") pod \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\" (UID: \"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d\") "
Oct 30 03:12:05.184643 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:05.184619    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kserve-provision-location" pod "6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" (UID: "6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:12:05.184643 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:05.184626    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kube-rbac-proxy-sar-config" pod "6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" (UID: "6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:12:05.184762 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:05.184627    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-cabundle-cert" pod "6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" (UID: "6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:12:05.186251 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:05.186203    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kube-api-access-dqdmw" pod "6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" (UID: "6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d"). InnerVolumeSpecName "kube-api-access-dqdmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:12:05.186342 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:05.186324    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-proxy-tls" pod "6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" (UID: "6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:12:05.285129 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:05.285095    5068 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqdmw\" (UniqueName: \"kubernetes.io/projected/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kube-api-access-dqdmw\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:12:05.285129 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:05.285124    5068 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-proxy-tls\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:12:05.285129 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:05.285135    5068 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-cabundle-cert\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:12:05.285342 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:05.285144    5068 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:12:05.285342 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:05.285154    5068 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d-kserve-provision-location\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:12:06.075573 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:06.075544    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"
Oct 30 03:12:06.076252 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:06.075542    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95" event={"ID":"6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d","Type":"ContainerDied","Data":"037992d9ab8ada073e93148f363a9807691e402e1686c542cb4ecc6047ef68ef"}
Oct 30 03:12:06.076252 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:06.075696    5068 scope.go:122] "RemoveContainer" containerID="522e46008a772a776aa4c016401c909cde83bb1bdaa3de10bf96b78350200ab6"
Oct 30 03:12:06.084208 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:06.084190    5068 scope.go:122] "RemoveContainer" containerID="2c0da0d63ca414aae7907d1874a6ad2cbd888d1d4cf6b109ef86530db7ed2c51"
Oct 30 03:12:06.094899 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:06.092898    5068 scope.go:122] "RemoveContainer" containerID="06d070dc144a96e476071ed4b3bac28f1c8b29d34a514324dd7bc437e89787f9"
Oct 30 03:12:06.133077 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:06.133053    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"]
Oct 30 03:12:06.138421 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:06.138398    5068 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-stop-predictor-94cccdcc4-wfz95"]
Oct 30 03:12:07.071578 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:07.071542    5068 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" path="/var/lib/kubelet/pods/6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d/volumes"
Oct 30 03:12:07.281440 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:12:07.281410    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:12:09.118124 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:09.118090    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"]
Oct 30 03:12:09.118569 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:09.118322    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="kserve-container" containerID="cri-o://ec803cf99e2251730727ccb808b274cf2f7f47ce4d0ecb024faf6af9b58d3f7f" gracePeriod=30
Oct 30 03:12:09.118569 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:09.118485    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="kube-rbac-proxy" containerID="cri-o://ef4602e8e4a83e3d3fb192238ce1e2ce1bcab34d0ea14402009c895b3f4c8833" gracePeriod=30
Oct 30 03:12:09.159835 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:09.159810    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:12:09.373013 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:09.372936    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:12:10.067221 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:10.067183    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Oct 30 03:12:10.093772 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:10.093739    5068 generic.go:356] "Generic (PLEG): container finished" podID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerID="ef4602e8e4a83e3d3fb192238ce1e2ce1bcab34d0ea14402009c895b3f4c8833" exitCode=0
Oct 30 03:12:10.093912 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:10.093810    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" event={"ID":"ca48d4b5-77a5-46c9-ab0a-715068e2bb98","Type":"ContainerDied","Data":"ef4602e8e4a83e3d3fb192238ce1e2ce1bcab34d0ea14402009c895b3f4c8833"}
Oct 30 03:12:12.679976 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:12.679932    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.32:8643/healthz\": dial tcp 10.132.0.32:8643: connect: connection refused"
Oct 30 03:12:13.762286 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:13.762262    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:12:13.851793 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:13.851701    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kserve-provision-location\") pod \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\" (UID: \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\") "
Oct 30 03:12:13.851793 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:13.851748    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kube-api-access-rcpgw\" (UniqueName: \"kubernetes.io/projected/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kube-api-access-rcpgw\") pod \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\" (UID: \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\") "
Oct 30 03:12:13.852016 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:13.851794    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-cabundle-cert\") pod \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\" (UID: \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\") "
Oct 30 03:12:13.852016 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:13.851878    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kube-rbac-proxy-sar-config\") pod \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\" (UID: \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\") "
Oct 30 03:12:13.852016 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:13.851909    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-proxy-tls\" (UniqueName: \"kubernetes.io/secret/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-proxy-tls\") pod \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\" (UID: \"ca48d4b5-77a5-46c9-ab0a-715068e2bb98\") "
Oct 30 03:12:13.852147 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:13.852061    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kserve-provision-location" pod "ca48d4b5-77a5-46c9-ab0a-715068e2bb98" (UID: "ca48d4b5-77a5-46c9-ab0a-715068e2bb98"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:12:13.852206 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:13.852196    5068 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kserve-provision-location\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:12:13.852295 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:13.852272    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-cabundle-cert" pod "ca48d4b5-77a5-46c9-ab0a-715068e2bb98" (UID: "ca48d4b5-77a5-46c9-ab0a-715068e2bb98"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:12:13.852338 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:13.852277    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kube-rbac-proxy-sar-config" pod "ca48d4b5-77a5-46c9-ab0a-715068e2bb98" (UID: "ca48d4b5-77a5-46c9-ab0a-715068e2bb98"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:12:13.853880 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:13.853844    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kube-api-access-rcpgw" pod "ca48d4b5-77a5-46c9-ab0a-715068e2bb98" (UID: "ca48d4b5-77a5-46c9-ab0a-715068e2bb98"). InnerVolumeSpecName "kube-api-access-rcpgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:12:13.854023 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:13.854007    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-proxy-tls" pod "ca48d4b5-77a5-46c9-ab0a-715068e2bb98" (UID: "ca48d4b5-77a5-46c9-ab0a-715068e2bb98"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:12:13.953563 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:13.953518    5068 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:12:13.953563 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:13.953560    5068 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-proxy-tls\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:12:13.953563 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:13.953573    5068 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcpgw\" (UniqueName: \"kubernetes.io/projected/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-kube-api-access-rcpgw\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:12:13.953563 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:13.953582    5068 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ca48d4b5-77a5-46c9-ab0a-715068e2bb98-cabundle-cert\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:12:14.005998 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:14.001870    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" podUID="86bcf91a-0769-4136-8610-960055ef9d30" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Oct 30 03:12:14.111193 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:14.111105    5068 generic.go:356] "Generic (PLEG): container finished" podID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerID="ec803cf99e2251730727ccb808b274cf2f7f47ce4d0ecb024faf6af9b58d3f7f" exitCode=0
Oct 30 03:12:14.111193 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:14.111168    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" event={"ID":"ca48d4b5-77a5-46c9-ab0a-715068e2bb98","Type":"ContainerDied","Data":"ec803cf99e2251730727ccb808b274cf2f7f47ce4d0ecb024faf6af9b58d3f7f"}
Oct 30 03:12:14.111193 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:14.111180    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"
Oct 30 03:12:14.111408 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:14.111220    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql" event={"ID":"ca48d4b5-77a5-46c9-ab0a-715068e2bb98","Type":"ContainerDied","Data":"fd8b48ce45f8153eb70f4e468f00f38240a60371975d39fe9b812af04fe6c94f"}
Oct 30 03:12:14.111408 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:14.111257    5068 scope.go:122] "RemoveContainer" containerID="ef4602e8e4a83e3d3fb192238ce1e2ce1bcab34d0ea14402009c895b3f4c8833"
Oct 30 03:12:14.120311 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:14.120294    5068 scope.go:122] "RemoveContainer" containerID="ec803cf99e2251730727ccb808b274cf2f7f47ce4d0ecb024faf6af9b58d3f7f"
Oct 30 03:12:14.128623 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:14.128607    5068 scope.go:122] "RemoveContainer" containerID="aaeca2a10d76d7a3c333d8dfb34082b8489cdb22ad9a91a859d84c41f784b8db"
Oct 30 03:12:14.136960 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:14.136929    5068 scope.go:122] "RemoveContainer" containerID="ef4602e8e4a83e3d3fb192238ce1e2ce1bcab34d0ea14402009c895b3f4c8833"
Oct 30 03:12:14.137212 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:12:14.137192    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef4602e8e4a83e3d3fb192238ce1e2ce1bcab34d0ea14402009c895b3f4c8833\": container with ID starting with ef4602e8e4a83e3d3fb192238ce1e2ce1bcab34d0ea14402009c895b3f4c8833 not found: ID does not exist" containerID="ef4602e8e4a83e3d3fb192238ce1e2ce1bcab34d0ea14402009c895b3f4c8833"
Oct 30 03:12:14.137275 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:14.137222    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef4602e8e4a83e3d3fb192238ce1e2ce1bcab34d0ea14402009c895b3f4c8833"} err="failed to get container status \"ef4602e8e4a83e3d3fb192238ce1e2ce1bcab34d0ea14402009c895b3f4c8833\": rpc error: code = NotFound desc = could not find container \"ef4602e8e4a83e3d3fb192238ce1e2ce1bcab34d0ea14402009c895b3f4c8833\": container with ID starting with ef4602e8e4a83e3d3fb192238ce1e2ce1bcab34d0ea14402009c895b3f4c8833 not found: ID does not exist"
Oct 30 03:12:14.137275 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:14.137240    5068 scope.go:122] "RemoveContainer" containerID="ec803cf99e2251730727ccb808b274cf2f7f47ce4d0ecb024faf6af9b58d3f7f"
Oct 30 03:12:14.137478 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:12:14.137458    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec803cf99e2251730727ccb808b274cf2f7f47ce4d0ecb024faf6af9b58d3f7f\": container with ID starting with ec803cf99e2251730727ccb808b274cf2f7f47ce4d0ecb024faf6af9b58d3f7f not found: ID does not exist" containerID="ec803cf99e2251730727ccb808b274cf2f7f47ce4d0ecb024faf6af9b58d3f7f"
Oct 30 03:12:14.137531 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:14.137486    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec803cf99e2251730727ccb808b274cf2f7f47ce4d0ecb024faf6af9b58d3f7f"} err="failed to get container status \"ec803cf99e2251730727ccb808b274cf2f7f47ce4d0ecb024faf6af9b58d3f7f\": rpc error: code = NotFound desc = could not find container \"ec803cf99e2251730727ccb808b274cf2f7f47ce4d0ecb024faf6af9b58d3f7f\": container with ID starting with ec803cf99e2251730727ccb808b274cf2f7f47ce4d0ecb024faf6af9b58d3f7f not found: ID does not exist"
Oct 30 03:12:14.137531 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:14.137505    5068 scope.go:122] "RemoveContainer" containerID="aaeca2a10d76d7a3c333d8dfb34082b8489cdb22ad9a91a859d84c41f784b8db"
Oct 30 03:12:14.137814 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:12:14.137789    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaeca2a10d76d7a3c333d8dfb34082b8489cdb22ad9a91a859d84c41f784b8db\": container with ID starting with aaeca2a10d76d7a3c333d8dfb34082b8489cdb22ad9a91a859d84c41f784b8db not found: ID does not exist" containerID="aaeca2a10d76d7a3c333d8dfb34082b8489cdb22ad9a91a859d84c41f784b8db"
Oct 30 03:12:14.137900 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:14.137823    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaeca2a10d76d7a3c333d8dfb34082b8489cdb22ad9a91a859d84c41f784b8db"} err="failed to get container status \"aaeca2a10d76d7a3c333d8dfb34082b8489cdb22ad9a91a859d84c41f784b8db\": rpc error: code = NotFound desc = could not find container \"aaeca2a10d76d7a3c333d8dfb34082b8489cdb22ad9a91a859d84c41f784b8db\": container with ID starting with aaeca2a10d76d7a3c333d8dfb34082b8489cdb22ad9a91a859d84c41f784b8db not found: ID does not exist"
Oct 30 03:12:14.158853 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:14.158819    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"]
Oct 30 03:12:14.163979 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:14.163959    5068 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-stop-v2-predictor-7ccd88cb85-dg9ql"]
Oct 30 03:12:15.072575 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:15.072544    5068 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" path="/var/lib/kubelet/pods/ca48d4b5-77a5-46c9-ab0a-715068e2bb98/volumes"
Oct 30 03:12:16.049842 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.049811    5068 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"]
Oct 30 03:12:16.050122 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.050110    5068 cpu_manager.go:414] "containerMap: removing container" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="kube-rbac-proxy"
Oct 30 03:12:16.050165 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.050124    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="kube-rbac-proxy"
Oct 30 03:12:16.050165 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.050133    5068 cpu_manager.go:414] "containerMap: removing container" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="kube-rbac-proxy"
Oct 30 03:12:16.050165 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.050139    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="kube-rbac-proxy"
Oct 30 03:12:16.050165 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.050153    5068 cpu_manager.go:414] "containerMap: removing container" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="storage-initializer"
Oct 30 03:12:16.050165 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.050159    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="storage-initializer"
Oct 30 03:12:16.050312 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.050167    5068 cpu_manager.go:414] "containerMap: removing container" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="storage-initializer"
Oct 30 03:12:16.050312 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.050173    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="storage-initializer"
Oct 30 03:12:16.050312 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.050182    5068 cpu_manager.go:414] "containerMap: removing container" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="kserve-container"
Oct 30 03:12:16.050312 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.050186    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="kserve-container"
Oct 30 03:12:16.050312 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.050198    5068 cpu_manager.go:414] "containerMap: removing container" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="kserve-container"
Oct 30 03:12:16.050312 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.050202    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="kserve-container"
Oct 30 03:12:16.050312 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.050250    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="kube-rbac-proxy"
Oct 30 03:12:16.050312 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.050256    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="kube-rbac-proxy"
Oct 30 03:12:16.050312 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.050264    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="ca48d4b5-77a5-46c9-ab0a-715068e2bb98" containerName="kserve-container"
Oct 30 03:12:16.050312 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.050271    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f99e38b-cbc2-4e21-ba33-43f4a4ddc04d" containerName="kserve-container"
Oct 30 03:12:16.069520 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.069491    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:12:16.202474 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.202442    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"]
Oct 30 03:12:16.202860 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.202553    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:12:16.216198 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.216178    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"seaweedfs-s3-creds\""
Oct 30 03:12:16.216468 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.216442    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"kube-root-ca.crt\""
Oct 30 03:12:16.216567 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.216475    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"openshift-service-ca.crt\""
Oct 30 03:12:16.216567 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.216498    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 03:12:16.225719 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.225676    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"isvc-primary-3aaa98-kube-rbac-proxy-sar-config\""
Oct 30 03:12:16.225719 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.225679    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"isvc-primary-3aaa98-predictor-serving-cert\""
Oct 30 03:12:16.225825 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.225731    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"default-dockercfg-57rzd\""
Oct 30 03:12:16.259241 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.259214    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:12:16.270369 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.270344    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kww84\" (UniqueName: \"kubernetes.io/projected/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kube-api-access-kww84\") pod \"isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q\" (UID: \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\") " pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:12:16.270486 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.270470    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kserve-provision-location\") pod \"isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q\" (UID: \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\") " pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:12:16.270551 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.270495    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-proxy-tls\") pod \"isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q\" (UID: \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\") " pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:12:16.270610 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.270555    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kube-rbac-proxy-sar-config\") pod \"isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q\" (UID: \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\") " pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:12:16.270610 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.270589    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-cabundle-cert\") pod \"isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q\" (UID: \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\") " pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:12:16.371456 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.371430    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kww84\" (UniqueName: \"kubernetes.io/projected/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kube-api-access-kww84\") pod \"isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q\" (UID: \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\") " pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:12:16.371567 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.371477    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kserve-provision-location\") pod \"isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q\" (UID: \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\") " pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:12:16.371567 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.371504    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-proxy-tls\") pod \"isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q\" (UID: \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\") " pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:12:16.371567 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.371542    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kube-rbac-proxy-sar-config\") pod \"isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q\" (UID: \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\") " pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:12:16.371798 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.371584    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-cabundle-cert\") pod \"isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q\" (UID: \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\") " pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:12:16.371984 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.371960    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kserve-provision-location\") pod \"isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q\" (UID: \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\") " pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:12:16.372271 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.372243    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-cabundle-cert\") pod \"isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q\" (UID: \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\") " pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:12:16.372352 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.372301    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kube-rbac-proxy-sar-config\") pod \"isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q\" (UID: \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\") " pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:12:16.373911 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.373892    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-proxy-tls\") pod \"isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q\" (UID: \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\") " pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:12:16.393596 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.393577    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kww84\" (UniqueName: \"kubernetes.io/projected/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kube-api-access-kww84\") pod \"isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q\" (UID: \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\") " pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:12:16.554809 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.554774    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:12:16.888089 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:16.888017    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"]
Oct 30 03:12:16.893805 ip-10-0-139-40 kubenswrapper[5068]: W1030 03:12:16.893774    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb35ec1_b2a8_4a29_9f6f_823039ad399b.slice/crio-c79497dbfb54337d969f59da2c67559575124af0c5601bcadd51458cb51559e8 WatchSource:0}: Error finding container c79497dbfb54337d969f59da2c67559575124af0c5601bcadd51458cb51559e8: Status 404 returned error can't find the container with id c79497dbfb54337d969f59da2c67559575124af0c5601bcadd51458cb51559e8
Oct 30 03:12:17.127024 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:17.126992    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" event={"ID":"aeb35ec1-b2a8-4a29-9f6f-823039ad399b","Type":"ContainerStarted","Data":"bcf79777bee59543653a22ca6a2ed4156826edda16ba96b45c36b499fcd5f168"}
Oct 30 03:12:17.127188 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:17.127048    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" event={"ID":"aeb35ec1-b2a8-4a29-9f6f-823039ad399b","Type":"ContainerStarted","Data":"c79497dbfb54337d969f59da2c67559575124af0c5601bcadd51458cb51559e8"}
Oct 30 03:12:21.143941 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:21.143906    5068 generic.go:356] "Generic (PLEG): container finished" podID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerID="bcf79777bee59543653a22ca6a2ed4156826edda16ba96b45c36b499fcd5f168" exitCode=0
Oct 30 03:12:21.144369 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:21.143949    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" event={"ID":"aeb35ec1-b2a8-4a29-9f6f-823039ad399b","Type":"ContainerDied","Data":"bcf79777bee59543653a22ca6a2ed4156826edda16ba96b45c36b499fcd5f168"}
Oct 30 03:12:22.149772 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:22.149737    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" event={"ID":"aeb35ec1-b2a8-4a29-9f6f-823039ad399b","Type":"ContainerStarted","Data":"57f3ff982e40cff284ebdb7bc1f00459cda71eaeca2921904afcb0570d21012d"}
Oct 30 03:12:22.150196 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:22.149798    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" event={"ID":"aeb35ec1-b2a8-4a29-9f6f-823039ad399b","Type":"ContainerStarted","Data":"1faf6b222d8a3742d56eb679ddb9a05c3a793699a42d80b4810d579db2050aaf"}
Oct 30 03:12:22.150196 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:22.150057    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:12:22.150317 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:22.150203    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:12:22.151723 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:22.151680    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Oct 30 03:12:22.203331 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:22.203294    5068 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" podStartSLOduration=2.62984163 podStartE2EDuration="6.203283219s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.573441589s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:12:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:12:22.202483396 +0000 UTC m=+999.277853607" watchObservedRunningTime="2026-10-30 03:12:22.203283219 +0000 UTC m=+999.278653430"
Oct 30 03:12:23.154591 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:23.154557    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Oct 30 03:12:24.001594 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:24.001557    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" podUID="86bcf91a-0769-4136-8610-960055ef9d30" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Oct 30 03:12:28.159300 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:28.159269    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:12:28.159775 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:28.159749    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Oct 30 03:12:34.002453 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:34.002408    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" podUID="86bcf91a-0769-4136-8610-960055ef9d30" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Oct 30 03:12:34.498072 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:34.498030    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:12:37.281579 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:12:37.281546    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:12:38.160312 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:38.160272    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Oct 30 03:12:44.002312 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:44.002271    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" podUID="86bcf91a-0769-4136-8610-960055ef9d30" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Oct 30 03:12:48.160022 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:48.159984    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Oct 30 03:12:54.001859 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:54.001826    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:12:58.160593 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:12:58.160510    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Oct 30 03:13:01.857008 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:01.856972    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:13:02.042152 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:02.042121    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:13:07.281368 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:13:07.281330    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:13:08.160522 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:08.160482    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Oct 30 03:13:12.386016 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:12.385985    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"]
Oct 30 03:13:12.386494 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:12.386271    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" podUID="86bcf91a-0769-4136-8610-960055ef9d30" containerName="kserve-container" containerID="cri-o://d6847838474058e324a1115b053abb497d285437f94f4dbc2b99736524ced57f" gracePeriod=30
Oct 30 03:13:12.386494 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:12.386302    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" podUID="86bcf91a-0769-4136-8610-960055ef9d30" containerName="kube-rbac-proxy" containerID="cri-o://618655d368a829b72073a0472dd6729108a8287e63901663d842506c4a15556b" gracePeriod=30
Oct 30 03:13:12.390482 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:12.390458    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:13:12.562289 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:12.562261    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:13:13.350343 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:13.350307    5068 generic.go:356] "Generic (PLEG): container finished" podID="86bcf91a-0769-4136-8610-960055ef9d30" containerID="618655d368a829b72073a0472dd6729108a8287e63901663d842506c4a15556b" exitCode=0
Oct 30 03:13:13.350504 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:13.350361    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" event={"ID":"86bcf91a-0769-4136-8610-960055ef9d30","Type":"ContainerDied","Data":"618655d368a829b72073a0472dd6729108a8287e63901663d842506c4a15556b"}
Oct 30 03:13:13.998167 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:13.998124    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" podUID="86bcf91a-0769-4136-8610-960055ef9d30" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.34:8643/healthz\": dial tcp 10.132.0.34:8643: connect: connection refused"
Oct 30 03:13:14.002388 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:14.002364    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" podUID="86bcf91a-0769-4136-8610-960055ef9d30" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Oct 30 03:13:16.042958 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.042936    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:13:16.142942 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.142916    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/86bcf91a-0769-4136-8610-960055ef9d30-kube-api-access-kxp6b\" (UniqueName: \"kubernetes.io/projected/86bcf91a-0769-4136-8610-960055ef9d30-kube-api-access-kxp6b\") pod \"86bcf91a-0769-4136-8610-960055ef9d30\" (UID: \"86bcf91a-0769-4136-8610-960055ef9d30\") "
Oct 30 03:13:16.143128 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.143000    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/86bcf91a-0769-4136-8610-960055ef9d30-proxy-tls\" (UniqueName: \"kubernetes.io/secret/86bcf91a-0769-4136-8610-960055ef9d30-proxy-tls\") pod \"86bcf91a-0769-4136-8610-960055ef9d30\" (UID: \"86bcf91a-0769-4136-8610-960055ef9d30\") "
Oct 30 03:13:16.143128 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.143036    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86bcf91a-0769-4136-8610-960055ef9d30-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/86bcf91a-0769-4136-8610-960055ef9d30-kserve-provision-location\") pod \"86bcf91a-0769-4136-8610-960055ef9d30\" (UID: \"86bcf91a-0769-4136-8610-960055ef9d30\") "
Oct 30 03:13:16.143128 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.143062    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/86bcf91a-0769-4136-8610-960055ef9d30-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/86bcf91a-0769-4136-8610-960055ef9d30-cabundle-cert\") pod \"86bcf91a-0769-4136-8610-960055ef9d30\" (UID: \"86bcf91a-0769-4136-8610-960055ef9d30\") "
Oct 30 03:13:16.143128 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.143082    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/86bcf91a-0769-4136-8610-960055ef9d30-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/86bcf91a-0769-4136-8610-960055ef9d30-kube-rbac-proxy-sar-config\") pod \"86bcf91a-0769-4136-8610-960055ef9d30\" (UID: \"86bcf91a-0769-4136-8610-960055ef9d30\") "
Oct 30 03:13:16.143433 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.143405    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86bcf91a-0769-4136-8610-960055ef9d30-kserve-provision-location" pod "86bcf91a-0769-4136-8610-960055ef9d30" (UID: "86bcf91a-0769-4136-8610-960055ef9d30"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:13:16.143554 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.143416    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86bcf91a-0769-4136-8610-960055ef9d30-cabundle-cert" pod "86bcf91a-0769-4136-8610-960055ef9d30" (UID: "86bcf91a-0769-4136-8610-960055ef9d30"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:13:16.143554 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.143515    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86bcf91a-0769-4136-8610-960055ef9d30-kube-rbac-proxy-sar-config" pod "86bcf91a-0769-4136-8610-960055ef9d30" (UID: "86bcf91a-0769-4136-8610-960055ef9d30"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:13:16.145131 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.145110    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86bcf91a-0769-4136-8610-960055ef9d30-kube-api-access-kxp6b" pod "86bcf91a-0769-4136-8610-960055ef9d30" (UID: "86bcf91a-0769-4136-8610-960055ef9d30"). InnerVolumeSpecName "kube-api-access-kxp6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:13:16.145217 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.145200    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86bcf91a-0769-4136-8610-960055ef9d30-proxy-tls" pod "86bcf91a-0769-4136-8610-960055ef9d30" (UID: "86bcf91a-0769-4136-8610-960055ef9d30"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:13:16.244276 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.244253    5068 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/86bcf91a-0769-4136-8610-960055ef9d30-cabundle-cert\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:13:16.244276 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.244277    5068 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/86bcf91a-0769-4136-8610-960055ef9d30-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:13:16.244276 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.244287    5068 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxp6b\" (UniqueName: \"kubernetes.io/projected/86bcf91a-0769-4136-8610-960055ef9d30-kube-api-access-kxp6b\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:13:16.244459 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.244297    5068 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/86bcf91a-0769-4136-8610-960055ef9d30-proxy-tls\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:13:16.244459 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.244307    5068 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/86bcf91a-0769-4136-8610-960055ef9d30-kserve-provision-location\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:13:16.368376 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.368344    5068 generic.go:356] "Generic (PLEG): container finished" podID="86bcf91a-0769-4136-8610-960055ef9d30" containerID="d6847838474058e324a1115b053abb497d285437f94f4dbc2b99736524ced57f" exitCode=0
Oct 30 03:13:16.368524 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.368409    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"
Oct 30 03:13:16.368524 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.368426    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" event={"ID":"86bcf91a-0769-4136-8610-960055ef9d30","Type":"ContainerDied","Data":"d6847838474058e324a1115b053abb497d285437f94f4dbc2b99736524ced57f"}
Oct 30 03:13:16.368524 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.368492    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd" event={"ID":"86bcf91a-0769-4136-8610-960055ef9d30","Type":"ContainerDied","Data":"07f28c5c69afaa4a150f994f163ab2c203c4da67f6632d8e34e7e8008230d4b6"}
Oct 30 03:13:16.368524 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.368520    5068 scope.go:122] "RemoveContainer" containerID="618655d368a829b72073a0472dd6729108a8287e63901663d842506c4a15556b"
Oct 30 03:13:16.377159 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.377146    5068 scope.go:122] "RemoveContainer" containerID="d6847838474058e324a1115b053abb497d285437f94f4dbc2b99736524ced57f"
Oct 30 03:13:16.384407 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.384394    5068 scope.go:122] "RemoveContainer" containerID="a376c21f325a13fd887c97d5ecd43b4396afa732b4ae3794e47c108dd6f39504"
Oct 30 03:13:16.391745 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.391725    5068 scope.go:122] "RemoveContainer" containerID="618655d368a829b72073a0472dd6729108a8287e63901663d842506c4a15556b"
Oct 30 03:13:16.391995 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:13:16.391975    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"618655d368a829b72073a0472dd6729108a8287e63901663d842506c4a15556b\": container with ID starting with 618655d368a829b72073a0472dd6729108a8287e63901663d842506c4a15556b not found: ID does not exist" containerID="618655d368a829b72073a0472dd6729108a8287e63901663d842506c4a15556b"
Oct 30 03:13:16.392056 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.392001    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"618655d368a829b72073a0472dd6729108a8287e63901663d842506c4a15556b"} err="failed to get container status \"618655d368a829b72073a0472dd6729108a8287e63901663d842506c4a15556b\": rpc error: code = NotFound desc = could not find container \"618655d368a829b72073a0472dd6729108a8287e63901663d842506c4a15556b\": container with ID starting with 618655d368a829b72073a0472dd6729108a8287e63901663d842506c4a15556b not found: ID does not exist"
Oct 30 03:13:16.392056 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.392016    5068 scope.go:122] "RemoveContainer" containerID="d6847838474058e324a1115b053abb497d285437f94f4dbc2b99736524ced57f"
Oct 30 03:13:16.392269 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:13:16.392249    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6847838474058e324a1115b053abb497d285437f94f4dbc2b99736524ced57f\": container with ID starting with d6847838474058e324a1115b053abb497d285437f94f4dbc2b99736524ced57f not found: ID does not exist" containerID="d6847838474058e324a1115b053abb497d285437f94f4dbc2b99736524ced57f"
Oct 30 03:13:16.392313 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.392277    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6847838474058e324a1115b053abb497d285437f94f4dbc2b99736524ced57f"} err="failed to get container status \"d6847838474058e324a1115b053abb497d285437f94f4dbc2b99736524ced57f\": rpc error: code = NotFound desc = could not find container \"d6847838474058e324a1115b053abb497d285437f94f4dbc2b99736524ced57f\": container with ID starting with d6847838474058e324a1115b053abb497d285437f94f4dbc2b99736524ced57f not found: ID does not exist"
Oct 30 03:13:16.392313 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.392294    5068 scope.go:122] "RemoveContainer" containerID="a376c21f325a13fd887c97d5ecd43b4396afa732b4ae3794e47c108dd6f39504"
Oct 30 03:13:16.392516 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:13:16.392499    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a376c21f325a13fd887c97d5ecd43b4396afa732b4ae3794e47c108dd6f39504\": container with ID starting with a376c21f325a13fd887c97d5ecd43b4396afa732b4ae3794e47c108dd6f39504 not found: ID does not exist" containerID="a376c21f325a13fd887c97d5ecd43b4396afa732b4ae3794e47c108dd6f39504"
Oct 30 03:13:16.392554 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.392527    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a376c21f325a13fd887c97d5ecd43b4396afa732b4ae3794e47c108dd6f39504"} err="failed to get container status \"a376c21f325a13fd887c97d5ecd43b4396afa732b4ae3794e47c108dd6f39504\": rpc error: code = NotFound desc = could not find container \"a376c21f325a13fd887c97d5ecd43b4396afa732b4ae3794e47c108dd6f39504\": container with ID starting with a376c21f325a13fd887c97d5ecd43b4396afa732b4ae3794e47c108dd6f39504 not found: ID does not exist"
Oct 30 03:13:16.414768 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.414673    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"]
Oct 30 03:13:16.424664 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:16.424645    5068 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-e6d7890379/isvc-xgboost-graph-raw-hpa-fdaf1-predictor-5b7bc4d7-2bzkd"]
Oct 30 03:13:17.071413 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:17.071383    5068 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="86bcf91a-0769-4136-8610-960055ef9d30" path="/var/lib/kubelet/pods/86bcf91a-0769-4136-8610-960055ef9d30/volumes"
Oct 30 03:13:18.160344 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:18.160307    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Oct 30 03:13:19.819329 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:19.819289    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:13:19.990531 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:19.990501    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:13:22.304075 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:22.304043    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:13:28.159712 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:28.159664    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Oct 30 03:13:34.615811 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:34.615777    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:13:37.281308 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:13:37.281273    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:13:38.067569 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:38.067539    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:13:39.918611 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:39.918579    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:13:40.090070 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:13:40.090038    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:14:01.473041 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.473004    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:14:01.537786 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.537750    5068 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"]
Oct 30 03:14:01.538256 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.538219    5068 cpu_manager.go:414] "containerMap: removing container" podUID="86bcf91a-0769-4136-8610-960055ef9d30" containerName="kserve-container"
Oct 30 03:14:01.538256 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.538239    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="86bcf91a-0769-4136-8610-960055ef9d30" containerName="kserve-container"
Oct 30 03:14:01.538351 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.538258    5068 cpu_manager.go:414] "containerMap: removing container" podUID="86bcf91a-0769-4136-8610-960055ef9d30" containerName="storage-initializer"
Oct 30 03:14:01.538351 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.538268    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="86bcf91a-0769-4136-8610-960055ef9d30" containerName="storage-initializer"
Oct 30 03:14:01.538351 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.538304    5068 cpu_manager.go:414] "containerMap: removing container" podUID="86bcf91a-0769-4136-8610-960055ef9d30" containerName="kube-rbac-proxy"
Oct 30 03:14:01.538351 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.538312    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="86bcf91a-0769-4136-8610-960055ef9d30" containerName="kube-rbac-proxy"
Oct 30 03:14:01.538516 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.538390    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="86bcf91a-0769-4136-8610-960055ef9d30" containerName="kserve-container"
Oct 30 03:14:01.538516 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.538405    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="86bcf91a-0769-4136-8610-960055ef9d30" containerName="kube-rbac-proxy"
Oct 30 03:14:01.541754 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.541732    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"
Oct 30 03:14:01.557216 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.557188    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"isvc-secondary-3aaa98-kube-rbac-proxy-sar-config\""
Oct 30 03:14:01.566895 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.566874    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"invalid-s3-sa-3aaa98-dockercfg-mtk5x\""
Oct 30 03:14:01.566895 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.566887    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"invalid-s3-secret-3aaa98\""
Oct 30 03:14:01.567058 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.566973    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"isvc-secondary-3aaa98-predictor-serving-cert\""
Oct 30 03:14:01.571270 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.571250    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"]
Oct 30 03:14:01.647551 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.647522    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:14:01.695799 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.695763    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kube-rbac-proxy-sar-config\") pod \"isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv\" (UID: \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\") " pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"
Oct 30 03:14:01.695799 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.695804    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-cabundle-cert\") pod \"isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv\" (UID: \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\") " pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"
Oct 30 03:14:01.695955 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.695828    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnjbd\" (UniqueName: \"kubernetes.io/projected/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kube-api-access-mnjbd\") pod \"isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv\" (UID: \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\") " pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"
Oct 30 03:14:01.695955 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.695938    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-proxy-tls\") pod \"isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv\" (UID: \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\") " pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"
Oct 30 03:14:01.696039 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.695988    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kserve-provision-location\") pod \"isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv\" (UID: \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\") " pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"
Oct 30 03:14:01.797129 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.797067    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kserve-provision-location\") pod \"isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv\" (UID: \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\") " pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"
Oct 30 03:14:01.797129 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.797114    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kube-rbac-proxy-sar-config\") pod \"isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv\" (UID: \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\") " pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"
Oct 30 03:14:01.797263 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.797134    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-cabundle-cert\") pod \"isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv\" (UID: \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\") " pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"
Oct 30 03:14:01.797263 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.797152    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnjbd\" (UniqueName: \"kubernetes.io/projected/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kube-api-access-mnjbd\") pod \"isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv\" (UID: \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\") " pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"
Oct 30 03:14:01.797263 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.797183    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-proxy-tls\") pod \"isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv\" (UID: \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\") " pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"
Oct 30 03:14:01.797551 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.797528    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kserve-provision-location\") pod \"isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv\" (UID: \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\") " pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"
Oct 30 03:14:01.797820 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.797800    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kube-rbac-proxy-sar-config\") pod \"isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv\" (UID: \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\") " pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"
Oct 30 03:14:01.797874 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.797845    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-cabundle-cert\") pod \"isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv\" (UID: \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\") " pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"
Oct 30 03:14:01.799754 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.799733    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-proxy-tls\") pod \"isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv\" (UID: \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\") " pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"
Oct 30 03:14:01.819174 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.819150    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnjbd\" (UniqueName: \"kubernetes.io/projected/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kube-api-access-mnjbd\") pod \"isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv\" (UID: \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\") " pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"
Oct 30 03:14:01.858161 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:01.858138    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"
Oct 30 03:14:02.171812 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:02.171775    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"]
Oct 30 03:14:02.177765 ip-10-0-139-40 kubenswrapper[5068]: W1030 03:14:02.177736    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1030e9_db7e_49e8_b9c7_57fd5955d11e.slice/crio-96a64741d996748176304efb6c169796a023abb5388e106b1d571ad98138324a WatchSource:0}: Error finding container 96a64741d996748176304efb6c169796a023abb5388e106b1d571ad98138324a: Status 404 returned error can't find the container with id 96a64741d996748176304efb6c169796a023abb5388e106b1d571ad98138324a
Oct 30 03:14:02.548418 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:02.548338    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv" event={"ID":"ce1030e9-db7e-49e8-b9c7-57fd5955d11e","Type":"ContainerStarted","Data":"06a67919d9bedd5cc7cb08f18d13f9ca39eac24158dccab8d3f7c0ede1a6aecb"}
Oct 30 03:14:02.548418 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:02.548409    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv" event={"ID":"ce1030e9-db7e-49e8-b9c7-57fd5955d11e","Type":"ContainerStarted","Data":"96a64741d996748176304efb6c169796a023abb5388e106b1d571ad98138324a"}
Oct 30 03:14:06.566051 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:06.566022    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-d44ea3c803_isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv_ce1030e9-db7e-49e8-b9c7-57fd5955d11e/storage-initializer/0.log"
Oct 30 03:14:06.566404 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:06.566062    5068 generic.go:356] "Generic (PLEG): container finished" podID="ce1030e9-db7e-49e8-b9c7-57fd5955d11e" containerID="06a67919d9bedd5cc7cb08f18d13f9ca39eac24158dccab8d3f7c0ede1a6aecb" exitCode=1
Oct 30 03:14:06.566404 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:06.566140    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv" event={"ID":"ce1030e9-db7e-49e8-b9c7-57fd5955d11e","Type":"ContainerDied","Data":"06a67919d9bedd5cc7cb08f18d13f9ca39eac24158dccab8d3f7c0ede1a6aecb"}
Oct 30 03:14:07.282509 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:14:07.282475    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:14:07.572694 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:07.572606    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-d44ea3c803_isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv_ce1030e9-db7e-49e8-b9c7-57fd5955d11e/storage-initializer/0.log"
Oct 30 03:14:07.573078 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:07.572677    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv" event={"ID":"ce1030e9-db7e-49e8-b9c7-57fd5955d11e","Type":"ContainerStarted","Data":"9139412b3afcb73960e72183c4fff469efc4a1bd1b0eb9e12eb7a1fa254e8cab"}
Oct 30 03:14:11.590668 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:11.590596    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-d44ea3c803_isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv_ce1030e9-db7e-49e8-b9c7-57fd5955d11e/storage-initializer/1.log"
Oct 30 03:14:11.591107 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:11.590985    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-d44ea3c803_isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv_ce1030e9-db7e-49e8-b9c7-57fd5955d11e/storage-initializer/0.log"
Oct 30 03:14:11.591107 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:11.591017    5068 generic.go:356] "Generic (PLEG): container finished" podID="ce1030e9-db7e-49e8-b9c7-57fd5955d11e" containerID="9139412b3afcb73960e72183c4fff469efc4a1bd1b0eb9e12eb7a1fa254e8cab" exitCode=1
Oct 30 03:14:11.591107 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:11.591060    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv" event={"ID":"ce1030e9-db7e-49e8-b9c7-57fd5955d11e","Type":"ContainerDied","Data":"9139412b3afcb73960e72183c4fff469efc4a1bd1b0eb9e12eb7a1fa254e8cab"}
Oct 30 03:14:11.591233 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:11.591111    5068 scope.go:122] "RemoveContainer" containerID="06a67919d9bedd5cc7cb08f18d13f9ca39eac24158dccab8d3f7c0ede1a6aecb"
Oct 30 03:14:11.591491 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:11.591471    5068 scope.go:122] "RemoveContainer" containerID="06a67919d9bedd5cc7cb08f18d13f9ca39eac24158dccab8d3f7c0ede1a6aecb"
Oct 30 03:14:11.601553 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:14:11.601532    5068 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-initializer\" with CrashLoopBackOff: \"back-off 10s restarting failed container=storage-initializer pod=isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv_e2e-gw1-d44ea3c803(ce1030e9-db7e-49e8-b9c7-57fd5955d11e)\"" pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv" podUID="ce1030e9-db7e-49e8-b9c7-57fd5955d11e"
Oct 30 03:14:11.601832 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:14:11.601811    5068 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_storage-initializer_isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv_e2e-gw1-d44ea3c803_ce1030e9-db7e-49e8-b9c7-57fd5955d11e_0 in pod sandbox 96a64741d996748176304efb6c169796a023abb5388e106b1d571ad98138324a from index: no such id: '06a67919d9bedd5cc7cb08f18d13f9ca39eac24158dccab8d3f7c0ede1a6aecb'" containerID="06a67919d9bedd5cc7cb08f18d13f9ca39eac24158dccab8d3f7c0ede1a6aecb"
Oct 30 03:14:11.601891 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:11.601842    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06a67919d9bedd5cc7cb08f18d13f9ca39eac24158dccab8d3f7c0ede1a6aecb"} err="rpc error: code = Unknown desc = failed to delete container k8s_storage-initializer_isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv_e2e-gw1-d44ea3c803_ce1030e9-db7e-49e8-b9c7-57fd5955d11e_0 in pod sandbox 96a64741d996748176304efb6c169796a023abb5388e106b1d571ad98138324a from index: no such id: '06a67919d9bedd5cc7cb08f18d13f9ca39eac24158dccab8d3f7c0ede1a6aecb'"
Oct 30 03:14:12.597297 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:12.597271    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-d44ea3c803_isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv_ce1030e9-db7e-49e8-b9c7-57fd5955d11e/storage-initializer/1.log"
Oct 30 03:14:17.643643 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.643608    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"]
Oct 30 03:14:17.756875 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.756821    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"]
Oct 30 03:14:17.757229 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.757080    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="kserve-container" containerID="cri-o://1faf6b222d8a3742d56eb679ddb9a05c3a793699a42d80b4810d579db2050aaf" gracePeriod=30
Oct 30 03:14:17.757229 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.757130    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="kube-rbac-proxy" containerID="cri-o://57f3ff982e40cff284ebdb7bc1f00459cda71eaeca2921904afcb0570d21012d" gracePeriod=30
Oct 30 03:14:17.782314 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.782287    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:14:17.784028 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.784012    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-d44ea3c803_isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv_ce1030e9-db7e-49e8-b9c7-57fd5955d11e/storage-initializer/1.log"
Oct 30 03:14:17.786378 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.786363    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"
Oct 30 03:14:17.824152 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.824128    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-cabundle-cert\") pod \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\" (UID: \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\") "
Oct 30 03:14:17.824248 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.824172    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kserve-provision-location\") pod \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\" (UID: \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\") "
Oct 30 03:14:17.824248 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.824208    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kube-api-access-mnjbd\" (UniqueName: \"kubernetes.io/projected/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kube-api-access-mnjbd\") pod \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\" (UID: \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\") "
Oct 30 03:14:17.824248 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.824234    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kube-rbac-proxy-sar-config\") pod \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\" (UID: \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\") "
Oct 30 03:14:17.824410 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.824265    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-proxy-tls\" (UniqueName: \"kubernetes.io/secret/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-proxy-tls\") pod \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\" (UID: \"ce1030e9-db7e-49e8-b9c7-57fd5955d11e\") "
Oct 30 03:14:17.824517 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.824502    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kserve-provision-location" pod "ce1030e9-db7e-49e8-b9c7-57fd5955d11e" (UID: "ce1030e9-db7e-49e8-b9c7-57fd5955d11e"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:14:17.824581 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.824476    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-cabundle-cert" pod "ce1030e9-db7e-49e8-b9c7-57fd5955d11e" (UID: "ce1030e9-db7e-49e8-b9c7-57fd5955d11e"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:14:17.824632 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.824586    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kube-rbac-proxy-sar-config" pod "ce1030e9-db7e-49e8-b9c7-57fd5955d11e" (UID: "ce1030e9-db7e-49e8-b9c7-57fd5955d11e"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:14:17.826221 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.826202    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kube-api-access-mnjbd" pod "ce1030e9-db7e-49e8-b9c7-57fd5955d11e" (UID: "ce1030e9-db7e-49e8-b9c7-57fd5955d11e"). InnerVolumeSpecName "kube-api-access-mnjbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:14:17.826324 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.826305    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-proxy-tls" pod "ce1030e9-db7e-49e8-b9c7-57fd5955d11e" (UID: "ce1030e9-db7e-49e8-b9c7-57fd5955d11e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:14:17.925608 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.925542    5068 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kserve-provision-location\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:14:17.925608 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.925579    5068 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnjbd\" (UniqueName: \"kubernetes.io/projected/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kube-api-access-mnjbd\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:14:17.925608 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.925616    5068 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:14:17.925798 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.925627    5068 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-proxy-tls\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:14:17.925798 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.925636    5068 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ce1030e9-db7e-49e8-b9c7-57fd5955d11e-cabundle-cert\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:14:17.973456 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:17.973428    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:14:18.067745 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:18.067717    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Oct 30 03:14:18.155053 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:18.155020    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.35:8643/healthz\": dial tcp 10.132.0.35:8643: connect: connection refused"
Oct 30 03:14:18.622705 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:18.622660    5068 generic.go:356] "Generic (PLEG): container finished" podID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerID="57f3ff982e40cff284ebdb7bc1f00459cda71eaeca2921904afcb0570d21012d" exitCode=0
Oct 30 03:14:18.622887 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:18.622725    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" event={"ID":"aeb35ec1-b2a8-4a29-9f6f-823039ad399b","Type":"ContainerDied","Data":"57f3ff982e40cff284ebdb7bc1f00459cda71eaeca2921904afcb0570d21012d"}
Oct 30 03:14:18.623931 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:18.623912    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-d44ea3c803_isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv_ce1030e9-db7e-49e8-b9c7-57fd5955d11e/storage-initializer/1.log"
Oct 30 03:14:18.624026 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:18.623972    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv" event={"ID":"ce1030e9-db7e-49e8-b9c7-57fd5955d11e","Type":"ContainerDied","Data":"96a64741d996748176304efb6c169796a023abb5388e106b1d571ad98138324a"}
Oct 30 03:14:18.624026 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:18.624016    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"
Oct 30 03:14:18.624095 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:18.624026    5068 scope.go:122] "RemoveContainer" containerID="9139412b3afcb73960e72183c4fff469efc4a1bd1b0eb9e12eb7a1fa254e8cab"
Oct 30 03:14:18.712855 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:18.712828    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"]
Oct 30 03:14:18.716403 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:18.716380    5068 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-secondary-3aaa98-predictor-7f8d68db97-2c2bv"]
Oct 30 03:14:19.071122 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:19.071047    5068 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ce1030e9-db7e-49e8-b9c7-57fd5955d11e" path="/var/lib/kubelet/pods/ce1030e9-db7e-49e8-b9c7-57fd5955d11e/volumes"
Oct 30 03:14:22.102002 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.101975    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:14:22.159725 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.159700    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kube-api-access-kww84\" (UniqueName: \"kubernetes.io/projected/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kube-api-access-kww84\") pod \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\" (UID: \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\") "
Oct 30 03:14:22.159864 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.159785    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kserve-provision-location\") pod \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\" (UID: \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\") "
Oct 30 03:14:22.159864 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.159829    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kube-rbac-proxy-sar-config\") pod \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\" (UID: \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\") "
Oct 30 03:14:22.159983 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.159885    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-proxy-tls\" (UniqueName: \"kubernetes.io/secret/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-proxy-tls\") pod \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\" (UID: \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\") "
Oct 30 03:14:22.159983 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.159932    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-cabundle-cert\") pod \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\" (UID: \"aeb35ec1-b2a8-4a29-9f6f-823039ad399b\") "
Oct 30 03:14:22.160189 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.160086    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kserve-provision-location" pod "aeb35ec1-b2a8-4a29-9f6f-823039ad399b" (UID: "aeb35ec1-b2a8-4a29-9f6f-823039ad399b"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:14:22.160382 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.160343    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kube-rbac-proxy-sar-config" pod "aeb35ec1-b2a8-4a29-9f6f-823039ad399b" (UID: "aeb35ec1-b2a8-4a29-9f6f-823039ad399b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:14:22.160498 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.160447    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-cabundle-cert" pod "aeb35ec1-b2a8-4a29-9f6f-823039ad399b" (UID: "aeb35ec1-b2a8-4a29-9f6f-823039ad399b"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:14:22.161944 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.161922    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kube-api-access-kww84" pod "aeb35ec1-b2a8-4a29-9f6f-823039ad399b" (UID: "aeb35ec1-b2a8-4a29-9f6f-823039ad399b"). InnerVolumeSpecName "kube-api-access-kww84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:14:22.162381 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.162358    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-proxy-tls" pod "aeb35ec1-b2a8-4a29-9f6f-823039ad399b" (UID: "aeb35ec1-b2a8-4a29-9f6f-823039ad399b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:14:22.260907 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.260852    5068 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kserve-provision-location\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:14:22.260907 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.260875    5068 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:14:22.260907 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.260885    5068 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-proxy-tls\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:14:22.260907 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.260896    5068 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-cabundle-cert\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:14:22.260907 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.260905    5068 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kww84\" (UniqueName: \"kubernetes.io/projected/aeb35ec1-b2a8-4a29-9f6f-823039ad399b-kube-api-access-kww84\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:14:22.643098 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.643065    5068 generic.go:356] "Generic (PLEG): container finished" podID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerID="1faf6b222d8a3742d56eb679ddb9a05c3a793699a42d80b4810d579db2050aaf" exitCode=0
Oct 30 03:14:22.643282 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.643120    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"
Oct 30 03:14:22.643282 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.643153    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" event={"ID":"aeb35ec1-b2a8-4a29-9f6f-823039ad399b","Type":"ContainerDied","Data":"1faf6b222d8a3742d56eb679ddb9a05c3a793699a42d80b4810d579db2050aaf"}
Oct 30 03:14:22.643282 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.643261    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q" event={"ID":"aeb35ec1-b2a8-4a29-9f6f-823039ad399b","Type":"ContainerDied","Data":"c79497dbfb54337d969f59da2c67559575124af0c5601bcadd51458cb51559e8"}
Oct 30 03:14:22.643443 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.643299    5068 scope.go:122] "RemoveContainer" containerID="57f3ff982e40cff284ebdb7bc1f00459cda71eaeca2921904afcb0570d21012d"
Oct 30 03:14:22.651809 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.651794    5068 scope.go:122] "RemoveContainer" containerID="1faf6b222d8a3742d56eb679ddb9a05c3a793699a42d80b4810d579db2050aaf"
Oct 30 03:14:22.659042 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.659021    5068 scope.go:122] "RemoveContainer" containerID="bcf79777bee59543653a22ca6a2ed4156826edda16ba96b45c36b499fcd5f168"
Oct 30 03:14:22.665739 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.665721    5068 scope.go:122] "RemoveContainer" containerID="57f3ff982e40cff284ebdb7bc1f00459cda71eaeca2921904afcb0570d21012d"
Oct 30 03:14:22.665957 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:14:22.665936    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57f3ff982e40cff284ebdb7bc1f00459cda71eaeca2921904afcb0570d21012d\": container with ID starting with 57f3ff982e40cff284ebdb7bc1f00459cda71eaeca2921904afcb0570d21012d not found: ID does not exist" containerID="57f3ff982e40cff284ebdb7bc1f00459cda71eaeca2921904afcb0570d21012d"
Oct 30 03:14:22.665997 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.665969    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57f3ff982e40cff284ebdb7bc1f00459cda71eaeca2921904afcb0570d21012d"} err="failed to get container status \"57f3ff982e40cff284ebdb7bc1f00459cda71eaeca2921904afcb0570d21012d\": rpc error: code = NotFound desc = could not find container \"57f3ff982e40cff284ebdb7bc1f00459cda71eaeca2921904afcb0570d21012d\": container with ID starting with 57f3ff982e40cff284ebdb7bc1f00459cda71eaeca2921904afcb0570d21012d not found: ID does not exist"
Oct 30 03:14:22.665997 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.665990    5068 scope.go:122] "RemoveContainer" containerID="1faf6b222d8a3742d56eb679ddb9a05c3a793699a42d80b4810d579db2050aaf"
Oct 30 03:14:22.666207 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:14:22.666190    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1faf6b222d8a3742d56eb679ddb9a05c3a793699a42d80b4810d579db2050aaf\": container with ID starting with 1faf6b222d8a3742d56eb679ddb9a05c3a793699a42d80b4810d579db2050aaf not found: ID does not exist" containerID="1faf6b222d8a3742d56eb679ddb9a05c3a793699a42d80b4810d579db2050aaf"
Oct 30 03:14:22.666248 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.666212    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1faf6b222d8a3742d56eb679ddb9a05c3a793699a42d80b4810d579db2050aaf"} err="failed to get container status \"1faf6b222d8a3742d56eb679ddb9a05c3a793699a42d80b4810d579db2050aaf\": rpc error: code = NotFound desc = could not find container \"1faf6b222d8a3742d56eb679ddb9a05c3a793699a42d80b4810d579db2050aaf\": container with ID starting with 1faf6b222d8a3742d56eb679ddb9a05c3a793699a42d80b4810d579db2050aaf not found: ID does not exist"
Oct 30 03:14:22.666248 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.666227    5068 scope.go:122] "RemoveContainer" containerID="bcf79777bee59543653a22ca6a2ed4156826edda16ba96b45c36b499fcd5f168"
Oct 30 03:14:22.666440 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:14:22.666422    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcf79777bee59543653a22ca6a2ed4156826edda16ba96b45c36b499fcd5f168\": container with ID starting with bcf79777bee59543653a22ca6a2ed4156826edda16ba96b45c36b499fcd5f168 not found: ID does not exist" containerID="bcf79777bee59543653a22ca6a2ed4156826edda16ba96b45c36b499fcd5f168"
Oct 30 03:14:22.666479 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.666443    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf79777bee59543653a22ca6a2ed4156826edda16ba96b45c36b499fcd5f168"} err="failed to get container status \"bcf79777bee59543653a22ca6a2ed4156826edda16ba96b45c36b499fcd5f168\": rpc error: code = NotFound desc = could not find container \"bcf79777bee59543653a22ca6a2ed4156826edda16ba96b45c36b499fcd5f168\": container with ID starting with bcf79777bee59543653a22ca6a2ed4156826edda16ba96b45c36b499fcd5f168 not found: ID does not exist"
Oct 30 03:14:22.702036 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.702010    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"]
Oct 30 03:14:22.711458 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:22.711430    5068 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-primary-3aaa98-predictor-57cdc67c54-n8m5q"]
Oct 30 03:14:23.071459 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:23.071386    5068 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" path="/var/lib/kubelet/pods/aeb35ec1-b2a8-4a29-9f6f-823039ad399b/volumes"
Oct 30 03:14:25.413297 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.413218    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:14:25.485872 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.485843    5068 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"]
Oct 30 03:14:25.486140 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.486129    5068 cpu_manager.go:414] "containerMap: removing container" podUID="ce1030e9-db7e-49e8-b9c7-57fd5955d11e" containerName="storage-initializer"
Oct 30 03:14:25.486188 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.486141    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce1030e9-db7e-49e8-b9c7-57fd5955d11e" containerName="storage-initializer"
Oct 30 03:14:25.486188 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.486151    5068 cpu_manager.go:414] "containerMap: removing container" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="kube-rbac-proxy"
Oct 30 03:14:25.486188 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.486156    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="kube-rbac-proxy"
Oct 30 03:14:25.486188 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.486167    5068 cpu_manager.go:414] "containerMap: removing container" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="kserve-container"
Oct 30 03:14:25.486188 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.486173    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="kserve-container"
Oct 30 03:14:25.486188 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.486188    5068 cpu_manager.go:414] "containerMap: removing container" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="storage-initializer"
Oct 30 03:14:25.486370 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.486193    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="storage-initializer"
Oct 30 03:14:25.486370 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.486241    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="kube-rbac-proxy"
Oct 30 03:14:25.486370 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.486250    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="aeb35ec1-b2a8-4a29-9f6f-823039ad399b" containerName="kserve-container"
Oct 30 03:14:25.486370 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.486257    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce1030e9-db7e-49e8-b9c7-57fd5955d11e" containerName="storage-initializer"
Oct 30 03:14:25.486370 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.486312    5068 cpu_manager.go:414] "containerMap: removing container" podUID="ce1030e9-db7e-49e8-b9c7-57fd5955d11e" containerName="storage-initializer"
Oct 30 03:14:25.486370 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.486317    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce1030e9-db7e-49e8-b9c7-57fd5955d11e" containerName="storage-initializer"
Oct 30 03:14:25.486370 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.486369    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce1030e9-db7e-49e8-b9c7-57fd5955d11e" containerName="storage-initializer"
Oct 30 03:14:25.490992 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.490972    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"
Oct 30 03:14:25.504500 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.504476    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"kube-root-ca.crt\""
Oct 30 03:14:25.513900 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.513877    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 03:14:25.514021 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.513902    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"fail-s3-secret-aed344\""
Oct 30 03:14:25.514021 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.513916    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"isvc-init-fail-aed344-predictor-serving-cert\""
Oct 30 03:14:25.514021 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.513932    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"openshift-service-ca.crt\""
Oct 30 03:14:25.514021 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.513954    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"isvc-init-fail-aed344-kube-rbac-proxy-sar-config\""
Oct 30 03:14:25.514227 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.514028    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"fail-s3-sa-aed344-dockercfg-hdz7p\""
Oct 30 03:14:25.518316 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.518297    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"]
Oct 30 03:14:25.585014 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.584986    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kube-rbac-proxy-sar-config\") pod \"isvc-init-fail-aed344-predictor-64979b9865-rgc26\" (UID: \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\") " pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"
Oct 30 03:14:25.585014 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.585013    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kserve-provision-location\") pod \"isvc-init-fail-aed344-predictor-64979b9865-rgc26\" (UID: \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\") " pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"
Oct 30 03:14:25.585164 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.585037    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/69a9096c-5d75-4c97-9148-95cfd01ad3d1-cabundle-cert\") pod \"isvc-init-fail-aed344-predictor-64979b9865-rgc26\" (UID: \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\") " pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"
Oct 30 03:14:25.585164 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.585118    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/69a9096c-5d75-4c97-9148-95cfd01ad3d1-proxy-tls\") pod \"isvc-init-fail-aed344-predictor-64979b9865-rgc26\" (UID: \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\") " pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"
Oct 30 03:14:25.585255 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.585239    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkwbc\" (UniqueName: \"kubernetes.io/projected/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kube-api-access-zkwbc\") pod \"isvc-init-fail-aed344-predictor-64979b9865-rgc26\" (UID: \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\") " pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"
Oct 30 03:14:25.686116 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.686047    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/69a9096c-5d75-4c97-9148-95cfd01ad3d1-cabundle-cert\") pod \"isvc-init-fail-aed344-predictor-64979b9865-rgc26\" (UID: \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\") " pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"
Oct 30 03:14:25.686116 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.686092    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/69a9096c-5d75-4c97-9148-95cfd01ad3d1-proxy-tls\") pod \"isvc-init-fail-aed344-predictor-64979b9865-rgc26\" (UID: \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\") " pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"
Oct 30 03:14:25.686300 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.686151    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkwbc\" (UniqueName: \"kubernetes.io/projected/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kube-api-access-zkwbc\") pod \"isvc-init-fail-aed344-predictor-64979b9865-rgc26\" (UID: \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\") " pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"
Oct 30 03:14:25.686300 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.686195    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kube-rbac-proxy-sar-config\") pod \"isvc-init-fail-aed344-predictor-64979b9865-rgc26\" (UID: \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\") " pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"
Oct 30 03:14:25.686300 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.686218    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kserve-provision-location\") pod \"isvc-init-fail-aed344-predictor-64979b9865-rgc26\" (UID: \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\") " pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"
Oct 30 03:14:25.686595 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.686571    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kserve-provision-location\") pod \"isvc-init-fail-aed344-predictor-64979b9865-rgc26\" (UID: \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\") " pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"
Oct 30 03:14:25.686802 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.686784    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/69a9096c-5d75-4c97-9148-95cfd01ad3d1-cabundle-cert\") pod \"isvc-init-fail-aed344-predictor-64979b9865-rgc26\" (UID: \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\") " pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"
Oct 30 03:14:25.686868 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.686796    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kube-rbac-proxy-sar-config\") pod \"isvc-init-fail-aed344-predictor-64979b9865-rgc26\" (UID: \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\") " pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"
Oct 30 03:14:25.688459 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.688443    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/69a9096c-5d75-4c97-9148-95cfd01ad3d1-proxy-tls\") pod \"isvc-init-fail-aed344-predictor-64979b9865-rgc26\" (UID: \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\") " pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"
Oct 30 03:14:25.707757 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.707733    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkwbc\" (UniqueName: \"kubernetes.io/projected/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kube-api-access-zkwbc\") pod \"isvc-init-fail-aed344-predictor-64979b9865-rgc26\" (UID: \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\") " pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"
Oct 30 03:14:25.724469 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.724429    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:14:25.807871 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:25.807841    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"
Oct 30 03:14:26.120864 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:26.120837    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"]
Oct 30 03:14:26.126488 ip-10-0-139-40 kubenswrapper[5068]: W1030 03:14:26.126462    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69a9096c_5d75_4c97_9148_95cfd01ad3d1.slice/crio-6927d0c39920d08dc00cebafbc0aae7921b8cd3f3e07cb2850f3242f154726f5 WatchSource:0}: Error finding container 6927d0c39920d08dc00cebafbc0aae7921b8cd3f3e07cb2850f3242f154726f5: Status 404 returned error can't find the container with id 6927d0c39920d08dc00cebafbc0aae7921b8cd3f3e07cb2850f3242f154726f5
Oct 30 03:14:26.661708 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:26.661651    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26" event={"ID":"69a9096c-5d75-4c97-9148-95cfd01ad3d1","Type":"ContainerStarted","Data":"31424232c18ea58c4c8ff7afc7f14b32b104041176061ff3430093270e908217"}
Oct 30 03:14:26.662192 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:26.661745    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26" event={"ID":"69a9096c-5d75-4c97-9148-95cfd01ad3d1","Type":"ContainerStarted","Data":"6927d0c39920d08dc00cebafbc0aae7921b8cd3f3e07cb2850f3242f154726f5"}
Oct 30 03:14:28.671174 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:28.671144    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-d44ea3c803_isvc-init-fail-aed344-predictor-64979b9865-rgc26_69a9096c-5d75-4c97-9148-95cfd01ad3d1/storage-initializer/0.log"
Oct 30 03:14:28.671550 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:28.671185    5068 generic.go:356] "Generic (PLEG): container finished" podID="69a9096c-5d75-4c97-9148-95cfd01ad3d1" containerID="31424232c18ea58c4c8ff7afc7f14b32b104041176061ff3430093270e908217" exitCode=1
Oct 30 03:14:28.671550 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:28.671216    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26" event={"ID":"69a9096c-5d75-4c97-9148-95cfd01ad3d1","Type":"ContainerDied","Data":"31424232c18ea58c4c8ff7afc7f14b32b104041176061ff3430093270e908217"}
Oct 30 03:14:29.677031 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:29.677003    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-d44ea3c803_isvc-init-fail-aed344-predictor-64979b9865-rgc26_69a9096c-5d75-4c97-9148-95cfd01ad3d1/storage-initializer/0.log"
Oct 30 03:14:29.677419 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:29.677100    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26" event={"ID":"69a9096c-5d75-4c97-9148-95cfd01ad3d1","Type":"ContainerStarted","Data":"6a699b830c1ec12ec5f3f33d53ec89bb69058393970a6ad79304caf50a3ee8b2"}
Oct 30 03:14:30.454757 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:30.454723    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"]
Oct 30 03:14:30.565396 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:30.565346    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:14:30.680813 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:30.680766    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26" podUID="69a9096c-5d75-4c97-9148-95cfd01ad3d1" containerName="storage-initializer" containerID="cri-o://6a699b830c1ec12ec5f3f33d53ec89bb69058393970a6ad79304caf50a3ee8b2" gracePeriod=30
Oct 30 03:14:33.622283 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.622260    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-d44ea3c803_isvc-init-fail-aed344-predictor-64979b9865-rgc26_69a9096c-5d75-4c97-9148-95cfd01ad3d1/storage-initializer/1.log"
Oct 30 03:14:33.622737 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.622717    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-d44ea3c803_isvc-init-fail-aed344-predictor-64979b9865-rgc26_69a9096c-5d75-4c97-9148-95cfd01ad3d1/storage-initializer/0.log"
Oct 30 03:14:33.625110 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.625089    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"
Oct 30 03:14:33.694018 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.693964    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-d44ea3c803_isvc-init-fail-aed344-predictor-64979b9865-rgc26_69a9096c-5d75-4c97-9148-95cfd01ad3d1/storage-initializer/1.log"
Oct 30 03:14:33.694371 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.694355    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-d44ea3c803_isvc-init-fail-aed344-predictor-64979b9865-rgc26_69a9096c-5d75-4c97-9148-95cfd01ad3d1/storage-initializer/0.log"
Oct 30 03:14:33.694458 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.694393    5068 generic.go:356] "Generic (PLEG): container finished" podID="69a9096c-5d75-4c97-9148-95cfd01ad3d1" containerID="6a699b830c1ec12ec5f3f33d53ec89bb69058393970a6ad79304caf50a3ee8b2" exitCode=1
Oct 30 03:14:33.694458 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.694442    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"
Oct 30 03:14:33.694564 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.694467    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26" event={"ID":"69a9096c-5d75-4c97-9148-95cfd01ad3d1","Type":"ContainerDied","Data":"6a699b830c1ec12ec5f3f33d53ec89bb69058393970a6ad79304caf50a3ee8b2"}
Oct 30 03:14:33.694564 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.694553    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26" event={"ID":"69a9096c-5d75-4c97-9148-95cfd01ad3d1","Type":"ContainerDied","Data":"6927d0c39920d08dc00cebafbc0aae7921b8cd3f3e07cb2850f3242f154726f5"}
Oct 30 03:14:33.694654 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.694593    5068 scope.go:122] "RemoveContainer" containerID="6a699b830c1ec12ec5f3f33d53ec89bb69058393970a6ad79304caf50a3ee8b2"
Oct 30 03:14:33.702347 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.702328    5068 scope.go:122] "RemoveContainer" containerID="31424232c18ea58c4c8ff7afc7f14b32b104041176061ff3430093270e908217"
Oct 30 03:14:33.709110 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.709094    5068 scope.go:122] "RemoveContainer" containerID="6a699b830c1ec12ec5f3f33d53ec89bb69058393970a6ad79304caf50a3ee8b2"
Oct 30 03:14:33.709366 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:14:33.709343    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a699b830c1ec12ec5f3f33d53ec89bb69058393970a6ad79304caf50a3ee8b2\": container with ID starting with 6a699b830c1ec12ec5f3f33d53ec89bb69058393970a6ad79304caf50a3ee8b2 not found: ID does not exist" containerID="6a699b830c1ec12ec5f3f33d53ec89bb69058393970a6ad79304caf50a3ee8b2"
Oct 30 03:14:33.709418 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.709377    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a699b830c1ec12ec5f3f33d53ec89bb69058393970a6ad79304caf50a3ee8b2"} err="failed to get container status \"6a699b830c1ec12ec5f3f33d53ec89bb69058393970a6ad79304caf50a3ee8b2\": rpc error: code = NotFound desc = could not find container \"6a699b830c1ec12ec5f3f33d53ec89bb69058393970a6ad79304caf50a3ee8b2\": container with ID starting with 6a699b830c1ec12ec5f3f33d53ec89bb69058393970a6ad79304caf50a3ee8b2 not found: ID does not exist"
Oct 30 03:14:33.709418 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.709394    5068 scope.go:122] "RemoveContainer" containerID="31424232c18ea58c4c8ff7afc7f14b32b104041176061ff3430093270e908217"
Oct 30 03:14:33.709630 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:14:33.709614    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31424232c18ea58c4c8ff7afc7f14b32b104041176061ff3430093270e908217\": container with ID starting with 31424232c18ea58c4c8ff7afc7f14b32b104041176061ff3430093270e908217 not found: ID does not exist" containerID="31424232c18ea58c4c8ff7afc7f14b32b104041176061ff3430093270e908217"
Oct 30 03:14:33.709672 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.709632    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31424232c18ea58c4c8ff7afc7f14b32b104041176061ff3430093270e908217"} err="failed to get container status \"31424232c18ea58c4c8ff7afc7f14b32b104041176061ff3430093270e908217\": rpc error: code = NotFound desc = could not find container \"31424232c18ea58c4c8ff7afc7f14b32b104041176061ff3430093270e908217\": container with ID starting with 31424232c18ea58c4c8ff7afc7f14b32b104041176061ff3430093270e908217 not found: ID does not exist"
Oct 30 03:14:33.742534 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.742512    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/69a9096c-5d75-4c97-9148-95cfd01ad3d1-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/69a9096c-5d75-4c97-9148-95cfd01ad3d1-cabundle-cert\") pod \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\" (UID: \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\") "
Oct 30 03:14:33.742625 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.742556    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kserve-provision-location\") pod \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\" (UID: \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\") "
Oct 30 03:14:33.742625 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.742589    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kube-api-access-zkwbc\" (UniqueName: \"kubernetes.io/projected/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kube-api-access-zkwbc\") pod \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\" (UID: \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\") "
Oct 30 03:14:33.742756 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.742630    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kube-rbac-proxy-sar-config\") pod \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\" (UID: \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\") "
Oct 30 03:14:33.742756 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.742675    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/69a9096c-5d75-4c97-9148-95cfd01ad3d1-proxy-tls\" (UniqueName: \"kubernetes.io/secret/69a9096c-5d75-4c97-9148-95cfd01ad3d1-proxy-tls\") pod \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\" (UID: \"69a9096c-5d75-4c97-9148-95cfd01ad3d1\") "
Oct 30 03:14:33.742941 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.742920    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kserve-provision-location" pod "69a9096c-5d75-4c97-9148-95cfd01ad3d1" (UID: "69a9096c-5d75-4c97-9148-95cfd01ad3d1"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:14:33.742991 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.742947    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69a9096c-5d75-4c97-9148-95cfd01ad3d1-cabundle-cert" pod "69a9096c-5d75-4c97-9148-95cfd01ad3d1" (UID: "69a9096c-5d75-4c97-9148-95cfd01ad3d1"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:14:33.743060 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.743038    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kube-rbac-proxy-sar-config" pod "69a9096c-5d75-4c97-9148-95cfd01ad3d1" (UID: "69a9096c-5d75-4c97-9148-95cfd01ad3d1"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:14:33.744722 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.744682    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69a9096c-5d75-4c97-9148-95cfd01ad3d1-proxy-tls" pod "69a9096c-5d75-4c97-9148-95cfd01ad3d1" (UID: "69a9096c-5d75-4c97-9148-95cfd01ad3d1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:14:33.744722 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.744707    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kube-api-access-zkwbc" pod "69a9096c-5d75-4c97-9148-95cfd01ad3d1" (UID: "69a9096c-5d75-4c97-9148-95cfd01ad3d1"). InnerVolumeSpecName "kube-api-access-zkwbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:14:33.844041 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.844003    5068 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:14:33.844041 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.844036    5068 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/69a9096c-5d75-4c97-9148-95cfd01ad3d1-proxy-tls\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:14:33.844041 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.844048    5068 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/69a9096c-5d75-4c97-9148-95cfd01ad3d1-cabundle-cert\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:14:33.844203 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.844056    5068 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kserve-provision-location\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:14:33.844203 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:33.844064    5068 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkwbc\" (UniqueName: \"kubernetes.io/projected/69a9096c-5d75-4c97-9148-95cfd01ad3d1-kube-api-access-zkwbc\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:14:34.067846 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:34.067816    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"]
Oct 30 03:14:34.074283 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:34.074257    5068 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-init-fail-aed344-predictor-64979b9865-rgc26"]
Oct 30 03:14:34.751502 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:34.751471    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:14:35.071519 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:35.071446    5068 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="69a9096c-5d75-4c97-9148-95cfd01ad3d1" path="/var/lib/kubelet/pods/69a9096c-5d75-4c97-9148-95cfd01ad3d1/volumes"
Oct 30 03:14:36.198081 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.198052    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:14:36.278788 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.278761    5068 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"]
Oct 30 03:14:36.279066 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.279054    5068 cpu_manager.go:414] "containerMap: removing container" podUID="69a9096c-5d75-4c97-9148-95cfd01ad3d1" containerName="storage-initializer"
Oct 30 03:14:36.279108 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.279068    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="69a9096c-5d75-4c97-9148-95cfd01ad3d1" containerName="storage-initializer"
Oct 30 03:14:36.279108 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.279099    5068 cpu_manager.go:414] "containerMap: removing container" podUID="69a9096c-5d75-4c97-9148-95cfd01ad3d1" containerName="storage-initializer"
Oct 30 03:14:36.279108 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.279104    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="69a9096c-5d75-4c97-9148-95cfd01ad3d1" containerName="storage-initializer"
Oct 30 03:14:36.279193 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.279165    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="69a9096c-5d75-4c97-9148-95cfd01ad3d1" containerName="storage-initializer"
Oct 30 03:14:36.279193 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.279175    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="69a9096c-5d75-4c97-9148-95cfd01ad3d1" containerName="storage-initializer"
Oct 30 03:14:36.283885 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.283865    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:14:36.297313 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.297291    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"openshift-service-ca.crt\""
Oct 30 03:14:36.306806 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.306780    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 03:14:36.306806 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.306800    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"seaweedfs-s3-creds\""
Oct 30 03:14:36.306957 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.306801    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"raw-sklearn-189ab-kube-rbac-proxy-sar-config\""
Oct 30 03:14:36.306957 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.306855    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"kube-root-ca.crt\""
Oct 30 03:14:36.306957 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.306933    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"raw-sklearn-189ab-predictor-serving-cert\""
Oct 30 03:14:36.307066 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.307019    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"default-dockercfg-57rzd\""
Oct 30 03:14:36.310473 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.310455    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"]
Oct 30 03:14:36.361334 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.361306    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/481beefa-5c9b-4288-b6d9-d777b9e6b069-proxy-tls\") pod \"raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r\" (UID: \"481beefa-5c9b-4288-b6d9-d777b9e6b069\") " pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:14:36.361450 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.361341    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb24l\" (UniqueName: \"kubernetes.io/projected/481beefa-5c9b-4288-b6d9-d777b9e6b069-kube-api-access-sb24l\") pod \"raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r\" (UID: \"481beefa-5c9b-4288-b6d9-d777b9e6b069\") " pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:14:36.361450 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.361385    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/481beefa-5c9b-4288-b6d9-d777b9e6b069-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r\" (UID: \"481beefa-5c9b-4288-b6d9-d777b9e6b069\") " pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:14:36.361516 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.361470    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/481beefa-5c9b-4288-b6d9-d777b9e6b069-cabundle-cert\") pod \"raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r\" (UID: \"481beefa-5c9b-4288-b6d9-d777b9e6b069\") " pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:14:36.361516 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.361505    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/481beefa-5c9b-4288-b6d9-d777b9e6b069-kserve-provision-location\") pod \"raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r\" (UID: \"481beefa-5c9b-4288-b6d9-d777b9e6b069\") " pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:14:36.363147 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.363124    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:14:36.462477 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.462408    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb24l\" (UniqueName: \"kubernetes.io/projected/481beefa-5c9b-4288-b6d9-d777b9e6b069-kube-api-access-sb24l\") pod \"raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r\" (UID: \"481beefa-5c9b-4288-b6d9-d777b9e6b069\") " pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:14:36.462477 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.462460    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/481beefa-5c9b-4288-b6d9-d777b9e6b069-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r\" (UID: \"481beefa-5c9b-4288-b6d9-d777b9e6b069\") " pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:14:36.462653 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.462495    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/481beefa-5c9b-4288-b6d9-d777b9e6b069-cabundle-cert\") pod \"raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r\" (UID: \"481beefa-5c9b-4288-b6d9-d777b9e6b069\") " pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:14:36.462653 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.462528    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/481beefa-5c9b-4288-b6d9-d777b9e6b069-kserve-provision-location\") pod \"raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r\" (UID: \"481beefa-5c9b-4288-b6d9-d777b9e6b069\") " pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:14:36.462804 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.462654    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/481beefa-5c9b-4288-b6d9-d777b9e6b069-proxy-tls\") pod \"raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r\" (UID: \"481beefa-5c9b-4288-b6d9-d777b9e6b069\") " pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:14:36.462979 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.462961    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/481beefa-5c9b-4288-b6d9-d777b9e6b069-kserve-provision-location\") pod \"raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r\" (UID: \"481beefa-5c9b-4288-b6d9-d777b9e6b069\") " pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:14:36.463259 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.463236    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/481beefa-5c9b-4288-b6d9-d777b9e6b069-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r\" (UID: \"481beefa-5c9b-4288-b6d9-d777b9e6b069\") " pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:14:36.463321 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.463254    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/481beefa-5c9b-4288-b6d9-d777b9e6b069-cabundle-cert\") pod \"raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r\" (UID: \"481beefa-5c9b-4288-b6d9-d777b9e6b069\") " pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:14:36.465072 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.465053    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/481beefa-5c9b-4288-b6d9-d777b9e6b069-proxy-tls\") pod \"raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r\" (UID: \"481beefa-5c9b-4288-b6d9-d777b9e6b069\") " pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:14:36.484549 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.484521    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb24l\" (UniqueName: \"kubernetes.io/projected/481beefa-5c9b-4288-b6d9-d777b9e6b069-kube-api-access-sb24l\") pod \"raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r\" (UID: \"481beefa-5c9b-4288-b6d9-d777b9e6b069\") " pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:14:36.600605 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.600574    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:14:36.912540 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:36.912506    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"]
Oct 30 03:14:36.917680 ip-10-0-139-40 kubenswrapper[5068]: W1030 03:14:36.917645    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod481beefa_5c9b_4288_b6d9_d777b9e6b069.slice/crio-254826ff59ea4b82eae4318f8250724c9d2c1eb0e79ad86dd35ce284be3e52b1 WatchSource:0}: Error finding container 254826ff59ea4b82eae4318f8250724c9d2c1eb0e79ad86dd35ce284be3e52b1: Status 404 returned error can't find the container with id 254826ff59ea4b82eae4318f8250724c9d2c1eb0e79ad86dd35ce284be3e52b1
Oct 30 03:14:37.282454 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:14:37.282378    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:14:37.717270 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:37.717233    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" event={"ID":"481beefa-5c9b-4288-b6d9-d777b9e6b069","Type":"ContainerStarted","Data":"5b7d146fce3c3e978ac37ee9b54ba657321d0c6209561303d451b0facc290a91"}
Oct 30 03:14:37.717440 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:37.717312    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" event={"ID":"481beefa-5c9b-4288-b6d9-d777b9e6b069","Type":"ContainerStarted","Data":"254826ff59ea4b82eae4318f8250724c9d2c1eb0e79ad86dd35ce284be3e52b1"}
Oct 30 03:14:41.734255 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:41.734220    5068 generic.go:356] "Generic (PLEG): container finished" podID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerID="5b7d146fce3c3e978ac37ee9b54ba657321d0c6209561303d451b0facc290a91" exitCode=0
Oct 30 03:14:41.734646 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:41.734290    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" event={"ID":"481beefa-5c9b-4288-b6d9-d777b9e6b069","Type":"ContainerDied","Data":"5b7d146fce3c3e978ac37ee9b54ba657321d0c6209561303d451b0facc290a91"}
Oct 30 03:14:42.740025 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:42.739992    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" event={"ID":"481beefa-5c9b-4288-b6d9-d777b9e6b069","Type":"ContainerStarted","Data":"92d95f8f752bece4217c5bf4d77aaa2a5c78e378a4512d00ae605e73fc152575"}
Oct 30 03:14:42.740472 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:42.740057    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" event={"ID":"481beefa-5c9b-4288-b6d9-d777b9e6b069","Type":"ContainerStarted","Data":"dd889a739c506829292a9fd12e204a65f1a258e0b5b180a86ef1bd49c38ef7aa"}
Oct 30 03:14:42.740472 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:42.740235    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:14:42.791273 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:42.791235    5068 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" podStartSLOduration=2.919245297 podStartE2EDuration="6.791222208s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.871976911s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:14:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:14:42.790481628 +0000 UTC m=+1139.865851838" watchObservedRunningTime="2026-10-30 03:14:42.791222208 +0000 UTC m=+1139.866592418"
Oct 30 03:14:43.744553 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:43.744524    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:14:43.745880 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:43.745854    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Oct 30 03:14:44.748471 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:44.748430    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Oct 30 03:14:49.523483 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:49.523454    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:14:49.753220 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:49.753190    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:14:49.753814 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:49.753782    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Oct 30 03:14:59.753800 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:14:59.753761    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Oct 30 03:15:07.280520 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:15:07.280480    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:15:09.754439 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:09.754400    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Oct 30 03:15:16.029984 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:16.029921    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:15:16.192262 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:16.192224    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:15:19.753958 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:19.753922    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Oct 30 03:15:29.754471 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:29.754431    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Oct 30 03:15:34.885331 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:34.885294    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:15:35.939809 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:35.939775    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:15:37.281613 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:15:37.281577    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:15:39.754362 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:39.754328    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Oct 30 03:15:43.170587 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:43.170553    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/1.log"
Oct 30 03:15:43.174316 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:43.174293    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/1.log"
Oct 30 03:15:47.824615 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:47.824579    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:15:47.895705 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:47.895660    5068 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"]
Oct 30 03:15:47.899390 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:47.899372    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:15:47.908903 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:47.908880    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aaab928f-36b0-4219-a615-d1dee7b0319b-proxy-tls\") pod \"isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn\" (UID: \"aaab928f-36b0-4219-a615-d1dee7b0319b\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:15:47.908992 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:47.908926    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aaab928f-36b0-4219-a615-d1dee7b0319b-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn\" (UID: \"aaab928f-36b0-4219-a615-d1dee7b0319b\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:15:47.909030 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:47.909019    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aaab928f-36b0-4219-a615-d1dee7b0319b-kserve-provision-location\") pod \"isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn\" (UID: \"aaab928f-36b0-4219-a615-d1dee7b0319b\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:15:47.909091 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:47.909076    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jccv5\" (UniqueName: \"kubernetes.io/projected/aaab928f-36b0-4219-a615-d1dee7b0319b-kube-api-access-jccv5\") pod \"isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn\" (UID: \"aaab928f-36b0-4219-a615-d1dee7b0319b\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:15:47.909167 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:47.909148    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/aaab928f-36b0-4219-a615-d1dee7b0319b-cabundle-cert\") pod \"isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn\" (UID: \"aaab928f-36b0-4219-a615-d1dee7b0319b\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:15:47.912536 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:47.912515    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-e6d7890379\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 03:15:47.912536 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:47.912515    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-e6d7890379\"/\"seaweedfs-s3-creds\""
Oct 30 03:15:47.912536 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:47.912536    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-e6d7890379\"/\"default-dockercfg-f9xch\""
Oct 30 03:15:47.912748 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:47.912548    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-e6d7890379\"/\"isvc-sklearn-scale-raw-8f7bb-predictor-serving-cert\""
Oct 30 03:15:47.915398 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:47.915383    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-e6d7890379\"/\"isvc-sklearn-scale-raw-8f7bb-kube-rbac-proxy-sar-config\""
Oct 30 03:15:47.929631 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:47.929610    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"]
Oct 30 03:15:47.998561 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:47.998531    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:15:48.009715 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:48.009674    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jccv5\" (UniqueName: \"kubernetes.io/projected/aaab928f-36b0-4219-a615-d1dee7b0319b-kube-api-access-jccv5\") pod \"isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn\" (UID: \"aaab928f-36b0-4219-a615-d1dee7b0319b\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:15:48.009842 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:48.009717    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/aaab928f-36b0-4219-a615-d1dee7b0319b-cabundle-cert\") pod \"isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn\" (UID: \"aaab928f-36b0-4219-a615-d1dee7b0319b\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:15:48.009917 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:48.009895    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aaab928f-36b0-4219-a615-d1dee7b0319b-proxy-tls\") pod \"isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn\" (UID: \"aaab928f-36b0-4219-a615-d1dee7b0319b\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:15:48.009972 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:48.009936    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aaab928f-36b0-4219-a615-d1dee7b0319b-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn\" (UID: \"aaab928f-36b0-4219-a615-d1dee7b0319b\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:15:48.009972 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:48.009963    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aaab928f-36b0-4219-a615-d1dee7b0319b-kserve-provision-location\") pod \"isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn\" (UID: \"aaab928f-36b0-4219-a615-d1dee7b0319b\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:15:48.010316 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:48.010290    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aaab928f-36b0-4219-a615-d1dee7b0319b-kserve-provision-location\") pod \"isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn\" (UID: \"aaab928f-36b0-4219-a615-d1dee7b0319b\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:15:48.010470 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:48.010448    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/aaab928f-36b0-4219-a615-d1dee7b0319b-cabundle-cert\") pod \"isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn\" (UID: \"aaab928f-36b0-4219-a615-d1dee7b0319b\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:15:48.010549 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:48.010533    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aaab928f-36b0-4219-a615-d1dee7b0319b-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn\" (UID: \"aaab928f-36b0-4219-a615-d1dee7b0319b\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:15:48.012263 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:48.012245    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aaab928f-36b0-4219-a615-d1dee7b0319b-proxy-tls\") pod \"isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn\" (UID: \"aaab928f-36b0-4219-a615-d1dee7b0319b\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:15:48.012958 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:48.012943    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-e6d7890379\"/\"openshift-service-ca.crt\""
Oct 30 03:15:48.013132 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:48.013115    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-e6d7890379\"/\"kube-root-ca.crt\""
Oct 30 03:15:48.032048 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:48.032023    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jccv5\" (UniqueName: \"kubernetes.io/projected/aaab928f-36b0-4219-a615-d1dee7b0319b-kube-api-access-jccv5\") pod \"isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn\" (UID: \"aaab928f-36b0-4219-a615-d1dee7b0319b\") " pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:15:48.216333 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:48.216299    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:15:48.537616 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:48.537413    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"]
Oct 30 03:15:48.540594 ip-10-0-139-40 kubenswrapper[5068]: W1030 03:15:48.540564    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaab928f_36b0_4219_a615_d1dee7b0319b.slice/crio-19de0897ee61f297dc4beff4c589c1c66a117fc6934d03d1820592c75c86d12c WatchSource:0}: Error finding container 19de0897ee61f297dc4beff4c589c1c66a117fc6934d03d1820592c75c86d12c: Status 404 returned error can't find the container with id 19de0897ee61f297dc4beff4c589c1c66a117fc6934d03d1820592c75c86d12c
Oct 30 03:15:49.009958 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:49.009923    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" event={"ID":"aaab928f-36b0-4219-a615-d1dee7b0319b","Type":"ContainerStarted","Data":"3202ac46491a277311a61f09dbce7a559f303e9df28eca889992fbcd0341bbfd"}
Oct 30 03:15:49.010334 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:49.010007    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" event={"ID":"aaab928f-36b0-4219-a615-d1dee7b0319b","Type":"ContainerStarted","Data":"19de0897ee61f297dc4beff4c589c1c66a117fc6934d03d1820592c75c86d12c"}
Oct 30 03:15:49.754257 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:49.754222    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Oct 30 03:15:53.027868 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:53.027827    5068 generic.go:356] "Generic (PLEG): container finished" podID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerID="3202ac46491a277311a61f09dbce7a559f303e9df28eca889992fbcd0341bbfd" exitCode=0
Oct 30 03:15:53.028274 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:53.027903    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" event={"ID":"aaab928f-36b0-4219-a615-d1dee7b0319b","Type":"ContainerDied","Data":"3202ac46491a277311a61f09dbce7a559f303e9df28eca889992fbcd0341bbfd"}
Oct 30 03:15:54.034807 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:54.034761    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" event={"ID":"aaab928f-36b0-4219-a615-d1dee7b0319b","Type":"ContainerStarted","Data":"6450ae6c949b27d2c243d97d1d2826be2a7a43beab82cb9c2a8eadd149a90ab9"}
Oct 30 03:15:54.035199 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:54.034846    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" event={"ID":"aaab928f-36b0-4219-a615-d1dee7b0319b","Type":"ContainerStarted","Data":"039742e8cbbc7d7230ce2521d2b12e246c987571a76639ada0ab1ca270d12562"}
Oct 30 03:15:54.035199 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:54.035060    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:15:54.102898 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:54.102846    5068 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podStartSLOduration=3.340197963 podStartE2EDuration="7.102831212s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.762633249s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:15:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:15:54.102413922 +0000 UTC m=+1211.177784133" watchObservedRunningTime="2026-10-30 03:15:54.102831212 +0000 UTC m=+1211.178201420"
Oct 30 03:15:55.038764 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:55.038680    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:15:55.039859 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:55.039834    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Oct 30 03:15:56.042298 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:56.042259    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Oct 30 03:15:59.754776 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:15:59.754743    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:16:01.046658 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:01.046630    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:16:01.047179 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:01.047155    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Oct 30 03:16:06.982413 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:06.982378    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"]
Oct 30 03:16:06.983040 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:06.982645    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="kserve-container" containerID="cri-o://dd889a739c506829292a9fd12e204a65f1a258e0b5b180a86ef1bd49c38ef7aa" gracePeriod=30
Oct 30 03:16:06.983040 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:06.982882    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="kube-rbac-proxy" containerID="cri-o://92d95f8f752bece4217c5bf4d77aaa2a5c78e378a4512d00ae605e73fc152575" gracePeriod=30
Oct 30 03:16:07.101997 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:07.101970    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:16:07.281421 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:16:07.281340    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:16:08.091313 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:08.091272    5068 generic.go:356] "Generic (PLEG): container finished" podID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerID="92d95f8f752bece4217c5bf4d77aaa2a5c78e378a4512d00ae605e73fc152575" exitCode=0
Oct 30 03:16:08.091681 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:08.091340    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" event={"ID":"481beefa-5c9b-4288-b6d9-d777b9e6b069","Type":"ContainerDied","Data":"92d95f8f752bece4217c5bf4d77aaa2a5c78e378a4512d00ae605e73fc152575"}
Oct 30 03:16:09.749334 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:09.749295    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.38:8643/healthz\": dial tcp 10.132.0.38:8643: connect: connection refused"
Oct 30 03:16:09.753741 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:09.753716    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Oct 30 03:16:11.047272 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:11.047232    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Oct 30 03:16:11.415976 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:11.415952    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:16:11.492732 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:11.492682    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/481beefa-5c9b-4288-b6d9-d777b9e6b069-proxy-tls\" (UniqueName: \"kubernetes.io/secret/481beefa-5c9b-4288-b6d9-d777b9e6b069-proxy-tls\") pod \"481beefa-5c9b-4288-b6d9-d777b9e6b069\" (UID: \"481beefa-5c9b-4288-b6d9-d777b9e6b069\") "
Oct 30 03:16:11.492915 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:11.492745    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/481beefa-5c9b-4288-b6d9-d777b9e6b069-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/481beefa-5c9b-4288-b6d9-d777b9e6b069-cabundle-cert\") pod \"481beefa-5c9b-4288-b6d9-d777b9e6b069\" (UID: \"481beefa-5c9b-4288-b6d9-d777b9e6b069\") "
Oct 30 03:16:11.492915 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:11.492784    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/481beefa-5c9b-4288-b6d9-d777b9e6b069-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/481beefa-5c9b-4288-b6d9-d777b9e6b069-kserve-provision-location\") pod \"481beefa-5c9b-4288-b6d9-d777b9e6b069\" (UID: \"481beefa-5c9b-4288-b6d9-d777b9e6b069\") "
Oct 30 03:16:11.492915 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:11.492827    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/481beefa-5c9b-4288-b6d9-d777b9e6b069-kube-api-access-sb24l\" (UniqueName: \"kubernetes.io/projected/481beefa-5c9b-4288-b6d9-d777b9e6b069-kube-api-access-sb24l\") pod \"481beefa-5c9b-4288-b6d9-d777b9e6b069\" (UID: \"481beefa-5c9b-4288-b6d9-d777b9e6b069\") "
Oct 30 03:16:11.492915 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:11.492852    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/481beefa-5c9b-4288-b6d9-d777b9e6b069-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/481beefa-5c9b-4288-b6d9-d777b9e6b069-kube-rbac-proxy-sar-config\") pod \"481beefa-5c9b-4288-b6d9-d777b9e6b069\" (UID: \"481beefa-5c9b-4288-b6d9-d777b9e6b069\") "
Oct 30 03:16:11.493137 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:11.493093    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/481beefa-5c9b-4288-b6d9-d777b9e6b069-cabundle-cert" pod "481beefa-5c9b-4288-b6d9-d777b9e6b069" (UID: "481beefa-5c9b-4288-b6d9-d777b9e6b069"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:16:11.493137 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:11.493104    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/481beefa-5c9b-4288-b6d9-d777b9e6b069-kserve-provision-location" pod "481beefa-5c9b-4288-b6d9-d777b9e6b069" (UID: "481beefa-5c9b-4288-b6d9-d777b9e6b069"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:16:11.493307 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:11.493283    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/481beefa-5c9b-4288-b6d9-d777b9e6b069-kube-rbac-proxy-sar-config" pod "481beefa-5c9b-4288-b6d9-d777b9e6b069" (UID: "481beefa-5c9b-4288-b6d9-d777b9e6b069"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:16:11.494741 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:11.494719    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/481beefa-5c9b-4288-b6d9-d777b9e6b069-proxy-tls" pod "481beefa-5c9b-4288-b6d9-d777b9e6b069" (UID: "481beefa-5c9b-4288-b6d9-d777b9e6b069"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:16:11.494887 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:11.494871    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/481beefa-5c9b-4288-b6d9-d777b9e6b069-kube-api-access-sb24l" pod "481beefa-5c9b-4288-b6d9-d777b9e6b069" (UID: "481beefa-5c9b-4288-b6d9-d777b9e6b069"). InnerVolumeSpecName "kube-api-access-sb24l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:16:11.594230 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:11.594149    5068 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/481beefa-5c9b-4288-b6d9-d777b9e6b069-cabundle-cert\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:16:11.594230 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:11.594186    5068 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/481beefa-5c9b-4288-b6d9-d777b9e6b069-kserve-provision-location\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:16:11.594230 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:11.594200    5068 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sb24l\" (UniqueName: \"kubernetes.io/projected/481beefa-5c9b-4288-b6d9-d777b9e6b069-kube-api-access-sb24l\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:16:11.594230 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:11.594213    5068 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/481beefa-5c9b-4288-b6d9-d777b9e6b069-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:16:11.594230 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:11.594226    5068 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/481beefa-5c9b-4288-b6d9-d777b9e6b069-proxy-tls\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:16:12.106829 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:12.106793    5068 generic.go:356] "Generic (PLEG): container finished" podID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerID="dd889a739c506829292a9fd12e204a65f1a258e0b5b180a86ef1bd49c38ef7aa" exitCode=0
Oct 30 03:16:12.107307 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:12.106864    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"
Oct 30 03:16:12.107307 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:12.106879    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" event={"ID":"481beefa-5c9b-4288-b6d9-d777b9e6b069","Type":"ContainerDied","Data":"dd889a739c506829292a9fd12e204a65f1a258e0b5b180a86ef1bd49c38ef7aa"}
Oct 30 03:16:12.107307 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:12.106936    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r" event={"ID":"481beefa-5c9b-4288-b6d9-d777b9e6b069","Type":"ContainerDied","Data":"254826ff59ea4b82eae4318f8250724c9d2c1eb0e79ad86dd35ce284be3e52b1"}
Oct 30 03:16:12.107307 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:12.106964    5068 scope.go:122] "RemoveContainer" containerID="92d95f8f752bece4217c5bf4d77aaa2a5c78e378a4512d00ae605e73fc152575"
Oct 30 03:16:12.115208 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:12.115194    5068 scope.go:122] "RemoveContainer" containerID="dd889a739c506829292a9fd12e204a65f1a258e0b5b180a86ef1bd49c38ef7aa"
Oct 30 03:16:12.122520 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:12.122503    5068 scope.go:122] "RemoveContainer" containerID="5b7d146fce3c3e978ac37ee9b54ba657321d0c6209561303d451b0facc290a91"
Oct 30 03:16:12.130935 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:12.130919    5068 scope.go:122] "RemoveContainer" containerID="92d95f8f752bece4217c5bf4d77aaa2a5c78e378a4512d00ae605e73fc152575"
Oct 30 03:16:12.131180 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:16:12.131164    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92d95f8f752bece4217c5bf4d77aaa2a5c78e378a4512d00ae605e73fc152575\": container with ID starting with 92d95f8f752bece4217c5bf4d77aaa2a5c78e378a4512d00ae605e73fc152575 not found: ID does not exist" containerID="92d95f8f752bece4217c5bf4d77aaa2a5c78e378a4512d00ae605e73fc152575"
Oct 30 03:16:12.131241 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:12.131188    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92d95f8f752bece4217c5bf4d77aaa2a5c78e378a4512d00ae605e73fc152575"} err="failed to get container status \"92d95f8f752bece4217c5bf4d77aaa2a5c78e378a4512d00ae605e73fc152575\": rpc error: code = NotFound desc = could not find container \"92d95f8f752bece4217c5bf4d77aaa2a5c78e378a4512d00ae605e73fc152575\": container with ID starting with 92d95f8f752bece4217c5bf4d77aaa2a5c78e378a4512d00ae605e73fc152575 not found: ID does not exist"
Oct 30 03:16:12.131241 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:12.131204    5068 scope.go:122] "RemoveContainer" containerID="dd889a739c506829292a9fd12e204a65f1a258e0b5b180a86ef1bd49c38ef7aa"
Oct 30 03:16:12.131433 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:16:12.131417    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd889a739c506829292a9fd12e204a65f1a258e0b5b180a86ef1bd49c38ef7aa\": container with ID starting with dd889a739c506829292a9fd12e204a65f1a258e0b5b180a86ef1bd49c38ef7aa not found: ID does not exist" containerID="dd889a739c506829292a9fd12e204a65f1a258e0b5b180a86ef1bd49c38ef7aa"
Oct 30 03:16:12.131477 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:12.131437    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd889a739c506829292a9fd12e204a65f1a258e0b5b180a86ef1bd49c38ef7aa"} err="failed to get container status \"dd889a739c506829292a9fd12e204a65f1a258e0b5b180a86ef1bd49c38ef7aa\": rpc error: code = NotFound desc = could not find container \"dd889a739c506829292a9fd12e204a65f1a258e0b5b180a86ef1bd49c38ef7aa\": container with ID starting with dd889a739c506829292a9fd12e204a65f1a258e0b5b180a86ef1bd49c38ef7aa not found: ID does not exist"
Oct 30 03:16:12.131477 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:12.131449    5068 scope.go:122] "RemoveContainer" containerID="5b7d146fce3c3e978ac37ee9b54ba657321d0c6209561303d451b0facc290a91"
Oct 30 03:16:12.131680 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:16:12.131665    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b7d146fce3c3e978ac37ee9b54ba657321d0c6209561303d451b0facc290a91\": container with ID starting with 5b7d146fce3c3e978ac37ee9b54ba657321d0c6209561303d451b0facc290a91 not found: ID does not exist" containerID="5b7d146fce3c3e978ac37ee9b54ba657321d0c6209561303d451b0facc290a91"
Oct 30 03:16:12.131774 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:12.131681    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b7d146fce3c3e978ac37ee9b54ba657321d0c6209561303d451b0facc290a91"} err="failed to get container status \"5b7d146fce3c3e978ac37ee9b54ba657321d0c6209561303d451b0facc290a91\": rpc error: code = NotFound desc = could not find container \"5b7d146fce3c3e978ac37ee9b54ba657321d0c6209561303d451b0facc290a91\": container with ID starting with 5b7d146fce3c3e978ac37ee9b54ba657321d0c6209561303d451b0facc290a91 not found: ID does not exist"
Oct 30 03:16:12.163261 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:12.163238    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"]
Oct 30 03:16:12.168770 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:12.168739    5068 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-d44ea3c803/raw-sklearn-189ab-predictor-6c5fddf4f5-kzs6r"]
Oct 30 03:16:13.073145 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:13.073112    5068 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" path="/var/lib/kubelet/pods/481beefa-5c9b-4288-b6d9-d777b9e6b069/volumes"
Oct 30 03:16:14.542635 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:14.542605    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:16:14.740702 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:14.740654    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:16:21.047497 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:21.047454    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Oct 30 03:16:27.062458 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:27.062420    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:16:31.047493 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:31.047454    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Oct 30 03:16:35.016203 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:35.016153    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:16:37.280951 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:16:37.280917    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:16:41.047554 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:41.047511    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Oct 30 03:16:51.047816 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:16:51.047767    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Oct 30 03:17:01.047752 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:01.047709    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Oct 30 03:17:07.283307 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:17:07.283250    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:17:11.047786 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:11.047752    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Oct 30 03:17:21.047789 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:21.047750    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Oct 30 03:17:25.066887 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:25.066806    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Oct 30 03:17:35.066670 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:35.066628    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Oct 30 03:17:35.132751 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:35.132716    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:17:37.281412 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:17:37.281377    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:17:45.067768 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:45.067714    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Oct 30 03:17:45.428483 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:45.428444    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:17:52.867319 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:52.867286    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:17:53.039583 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.039544    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:17:53.107037 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.107004    5068 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"]
Oct 30 03:17:53.107316 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.107304    5068 cpu_manager.go:414] "containerMap: removing container" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="storage-initializer"
Oct 30 03:17:53.107364 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.107317    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="storage-initializer"
Oct 30 03:17:53.107364 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.107334    5068 cpu_manager.go:414] "containerMap: removing container" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="kube-rbac-proxy"
Oct 30 03:17:53.107364 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.107340    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="kube-rbac-proxy"
Oct 30 03:17:53.107364 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.107364    5068 cpu_manager.go:414] "containerMap: removing container" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="kserve-container"
Oct 30 03:17:53.107525 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.107369    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="kserve-container"
Oct 30 03:17:53.107525 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.107418    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="kserve-container"
Oct 30 03:17:53.107525 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.107428    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="481beefa-5c9b-4288-b6d9-d777b9e6b069" containerName="kube-rbac-proxy"
Oct 30 03:17:53.110875 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.110852    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:17:53.137084 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.137051    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"]
Oct 30 03:17:53.186352 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.186323    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"isvc-canary-create-kube-rbac-proxy-sar-config\""
Oct 30 03:17:53.186352 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.186329    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 03:17:53.186549 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.186356    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"isvc-canary-create-predictor-serving-cert\""
Oct 30 03:17:53.186549 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.186369    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"kube-root-ca.crt\""
Oct 30 03:17:53.186549 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.186329    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"openshift-service-ca.crt\""
Oct 30 03:17:53.186549 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.186443    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"seaweedfs-s3-creds\""
Oct 30 03:17:53.186860 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.186846    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"default-dockercfg-57rzd\""
Oct 30 03:17:53.237633 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.237600    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kserve-provision-location\") pod \"isvc-canary-create-predictor-57bc666c8b-68snk\" (UID: \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\") " pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:17:53.237633 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.237641    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-cabundle-cert\") pod \"isvc-canary-create-predictor-57bc666c8b-68snk\" (UID: \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\") " pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:17:53.237889 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.237772    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-57bc666c8b-68snk\" (UID: \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\") " pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:17:53.237889 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.237803    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-proxy-tls\") pod \"isvc-canary-create-predictor-57bc666c8b-68snk\" (UID: \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\") " pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:17:53.237889 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.237833    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49vhf\" (UniqueName: \"kubernetes.io/projected/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kube-api-access-49vhf\") pod \"isvc-canary-create-predictor-57bc666c8b-68snk\" (UID: \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\") " pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:17:53.271396 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.271355    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:17:53.338626 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.338589    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kserve-provision-location\") pod \"isvc-canary-create-predictor-57bc666c8b-68snk\" (UID: \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\") " pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:17:53.338626 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.338627    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-cabundle-cert\") pod \"isvc-canary-create-predictor-57bc666c8b-68snk\" (UID: \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\") " pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:17:53.338844 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.338767    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-57bc666c8b-68snk\" (UID: \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\") " pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:17:53.338844 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.338815    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-proxy-tls\") pod \"isvc-canary-create-predictor-57bc666c8b-68snk\" (UID: \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\") " pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:17:53.338948 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.338869    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49vhf\" (UniqueName: \"kubernetes.io/projected/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kube-api-access-49vhf\") pod \"isvc-canary-create-predictor-57bc666c8b-68snk\" (UID: \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\") " pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:17:53.339087 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.339067    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kserve-provision-location\") pod \"isvc-canary-create-predictor-57bc666c8b-68snk\" (UID: \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\") " pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:17:53.339345 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.339326    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-cabundle-cert\") pod \"isvc-canary-create-predictor-57bc666c8b-68snk\" (UID: \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\") " pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:17:53.339421 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.339403    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-57bc666c8b-68snk\" (UID: \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\") " pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:17:53.341318 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.341298    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-proxy-tls\") pod \"isvc-canary-create-predictor-57bc666c8b-68snk\" (UID: \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\") " pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:17:53.360780 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.360752    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49vhf\" (UniqueName: \"kubernetes.io/projected/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kube-api-access-49vhf\") pod \"isvc-canary-create-predictor-57bc666c8b-68snk\" (UID: \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\") " pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:17:53.427542 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.427453    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:17:53.742032 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:53.741939    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"]
Oct 30 03:17:53.747325 ip-10-0-139-40 kubenswrapper[5068]: W1030 03:17:53.747290    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda999faf3_3c91_41e0_b8b9_7e7cc7df9cc6.slice/crio-809d3e5d76fed334eecaed4eb19e3745f35d0891f09699ec76dd40c13db81aa7 WatchSource:0}: Error finding container 809d3e5d76fed334eecaed4eb19e3745f35d0891f09699ec76dd40c13db81aa7: Status 404 returned error can't find the container with id 809d3e5d76fed334eecaed4eb19e3745f35d0891f09699ec76dd40c13db81aa7
Oct 30 03:17:54.512965 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:54.512928    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" event={"ID":"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6","Type":"ContainerStarted","Data":"490dd640b2c3bf4513c64ffd1018e07419cf844f9cd2e0442e3f5a30e8b942f6"}
Oct 30 03:17:54.513369 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:54.513004    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" event={"ID":"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6","Type":"ContainerStarted","Data":"809d3e5d76fed334eecaed4eb19e3745f35d0891f09699ec76dd40c13db81aa7"}
Oct 30 03:17:55.067377 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:55.067338    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Oct 30 03:17:57.526258 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:57.526223    5068 generic.go:356] "Generic (PLEG): container finished" podID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerID="490dd640b2c3bf4513c64ffd1018e07419cf844f9cd2e0442e3f5a30e8b942f6" exitCode=0
Oct 30 03:17:57.526754 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:57.526274    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" event={"ID":"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6","Type":"ContainerDied","Data":"490dd640b2c3bf4513c64ffd1018e07419cf844f9cd2e0442e3f5a30e8b942f6"}
Oct 30 03:17:58.533112 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:58.533079    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" event={"ID":"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6","Type":"ContainerStarted","Data":"90ac0e5bbdbfabd4f3f7dd018c2a0963f10eef82436cc74d841b1ab76cc59efd"}
Oct 30 03:17:58.533649 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:58.533140    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" event={"ID":"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6","Type":"ContainerStarted","Data":"fb3d1acd1a8e09d2ff3b7e546b52e3ecbf8fb1f26a141f7fa1a8db35aace2974"}
Oct 30 03:17:58.533649 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:58.533425    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:17:58.533649 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:58.533566    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:17:58.534946 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:58.534922    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.40:8080: connect: connection refused"
Oct 30 03:17:58.595491 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:58.595447    5068 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" podStartSLOduration=2.104562124 podStartE2EDuration="5.595434862s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.490872738s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:17:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:17:58.584945179 +0000 UTC m=+1335.660315389" watchObservedRunningTime="2026-10-30 03:17:58.595434862 +0000 UTC m=+1335.670805072"
Oct 30 03:17:59.538148 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:17:59.538111    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.40:8080: connect: connection refused"
Oct 30 03:18:04.542850 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:04.542820    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:18:04.543353 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:04.543323    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.40:8080: connect: connection refused"
Oct 30 03:18:05.066864 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:05.066819    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Oct 30 03:18:07.280507 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:18:07.280473    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:18:14.544004 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:14.543961    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.40:8080: connect: connection refused"
Oct 30 03:18:15.067459 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:15.067420    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Oct 30 03:18:24.543450 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:24.543411    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.40:8080: connect: connection refused"
Oct 30 03:18:25.066944 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:25.066900    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Oct 30 03:18:32.067569 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:32.067534    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:18:34.543942 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:34.543901    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.40:8080: connect: connection refused"
Oct 30 03:18:35.305487 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:35.305450    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:18:37.281267 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:18:37.281233    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:18:40.085303 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:40.085272    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"]
Oct 30 03:18:40.085819 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:40.085484    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container" containerID="cri-o://039742e8cbbc7d7230ce2521d2b12e246c987571a76639ada0ab1ca270d12562" gracePeriod=30
Oct 30 03:18:40.085819 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:40.085569    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kube-rbac-proxy" containerID="cri-o://6450ae6c949b27d2c243d97d1d2826be2a7a43beab82cb9c2a8eadd149a90ab9" gracePeriod=30
Oct 30 03:18:40.164082 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:40.164052    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:18:40.698797 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:40.698764    5068 generic.go:356] "Generic (PLEG): container finished" podID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerID="6450ae6c949b27d2c243d97d1d2826be2a7a43beab82cb9c2a8eadd149a90ab9" exitCode=0
Oct 30 03:18:40.698961 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:40.698839    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" event={"ID":"aaab928f-36b0-4219-a615-d1dee7b0319b","Type":"ContainerDied","Data":"6450ae6c949b27d2c243d97d1d2826be2a7a43beab82cb9c2a8eadd149a90ab9"}
Oct 30 03:18:41.042665 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:41.042576    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.39:8643/healthz\": dial tcp 10.132.0.39:8643: connect: connection refused"
Oct 30 03:18:42.067128 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:42.067087    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Oct 30 03:18:44.543360 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:44.543321    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.40:8080: connect: connection refused"
Oct 30 03:18:46.043212 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:46.043166    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.39:8643/healthz\": dial tcp 10.132.0.39:8643: connect: connection refused"
Oct 30 03:18:49.565181 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:49.565129    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:18:50.327701 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.327669    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:18:50.381222 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.381159    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aaab928f-36b0-4219-a615-d1dee7b0319b-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/aaab928f-36b0-4219-a615-d1dee7b0319b-cabundle-cert\") pod \"aaab928f-36b0-4219-a615-d1dee7b0319b\" (UID: \"aaab928f-36b0-4219-a615-d1dee7b0319b\") "
Oct 30 03:18:50.381222 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.381210    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aaab928f-36b0-4219-a615-d1dee7b0319b-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aaab928f-36b0-4219-a615-d1dee7b0319b-kserve-provision-location\") pod \"aaab928f-36b0-4219-a615-d1dee7b0319b\" (UID: \"aaab928f-36b0-4219-a615-d1dee7b0319b\") "
Oct 30 03:18:50.381405 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.381242    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aaab928f-36b0-4219-a615-d1dee7b0319b-kube-api-access-jccv5\" (UniqueName: \"kubernetes.io/projected/aaab928f-36b0-4219-a615-d1dee7b0319b-kube-api-access-jccv5\") pod \"aaab928f-36b0-4219-a615-d1dee7b0319b\" (UID: \"aaab928f-36b0-4219-a615-d1dee7b0319b\") "
Oct 30 03:18:50.381405 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.381290    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aaab928f-36b0-4219-a615-d1dee7b0319b-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aaab928f-36b0-4219-a615-d1dee7b0319b-kube-rbac-proxy-sar-config\") pod \"aaab928f-36b0-4219-a615-d1dee7b0319b\" (UID: \"aaab928f-36b0-4219-a615-d1dee7b0319b\") "
Oct 30 03:18:50.381405 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.381322    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aaab928f-36b0-4219-a615-d1dee7b0319b-proxy-tls\" (UniqueName: \"kubernetes.io/secret/aaab928f-36b0-4219-a615-d1dee7b0319b-proxy-tls\") pod \"aaab928f-36b0-4219-a615-d1dee7b0319b\" (UID: \"aaab928f-36b0-4219-a615-d1dee7b0319b\") "
Oct 30 03:18:50.381578 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.381525    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaab928f-36b0-4219-a615-d1dee7b0319b-cabundle-cert" pod "aaab928f-36b0-4219-a615-d1dee7b0319b" (UID: "aaab928f-36b0-4219-a615-d1dee7b0319b"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:18:50.381636 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.381593    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaab928f-36b0-4219-a615-d1dee7b0319b-kserve-provision-location" pod "aaab928f-36b0-4219-a615-d1dee7b0319b" (UID: "aaab928f-36b0-4219-a615-d1dee7b0319b"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:18:50.381636 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.381613    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaab928f-36b0-4219-a615-d1dee7b0319b-kube-rbac-proxy-sar-config" pod "aaab928f-36b0-4219-a615-d1dee7b0319b" (UID: "aaab928f-36b0-4219-a615-d1dee7b0319b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:18:50.383481 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.383444    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaab928f-36b0-4219-a615-d1dee7b0319b-proxy-tls" pod "aaab928f-36b0-4219-a615-d1dee7b0319b" (UID: "aaab928f-36b0-4219-a615-d1dee7b0319b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:18:50.383582 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.383560    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaab928f-36b0-4219-a615-d1dee7b0319b-kube-api-access-jccv5" pod "aaab928f-36b0-4219-a615-d1dee7b0319b" (UID: "aaab928f-36b0-4219-a615-d1dee7b0319b"). InnerVolumeSpecName "kube-api-access-jccv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:18:50.482081 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.482052    5068 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/aaab928f-36b0-4219-a615-d1dee7b0319b-cabundle-cert\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:18:50.482081 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.482081    5068 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aaab928f-36b0-4219-a615-d1dee7b0319b-kserve-provision-location\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:18:50.482238 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.482091    5068 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jccv5\" (UniqueName: \"kubernetes.io/projected/aaab928f-36b0-4219-a615-d1dee7b0319b-kube-api-access-jccv5\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:18:50.482238 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.482100    5068 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aaab928f-36b0-4219-a615-d1dee7b0319b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:18:50.482238 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.482110    5068 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aaab928f-36b0-4219-a615-d1dee7b0319b-proxy-tls\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:18:50.740001 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.739919    5068 generic.go:356] "Generic (PLEG): container finished" podID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerID="039742e8cbbc7d7230ce2521d2b12e246c987571a76639ada0ab1ca270d12562" exitCode=0
Oct 30 03:18:50.740001 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.739985    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"
Oct 30 03:18:50.740452 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.739994    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" event={"ID":"aaab928f-36b0-4219-a615-d1dee7b0319b","Type":"ContainerDied","Data":"039742e8cbbc7d7230ce2521d2b12e246c987571a76639ada0ab1ca270d12562"}
Oct 30 03:18:50.740452 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.740052    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn" event={"ID":"aaab928f-36b0-4219-a615-d1dee7b0319b","Type":"ContainerDied","Data":"19de0897ee61f297dc4beff4c589c1c66a117fc6934d03d1820592c75c86d12c"}
Oct 30 03:18:50.740452 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.740078    5068 scope.go:122] "RemoveContainer" containerID="6450ae6c949b27d2c243d97d1d2826be2a7a43beab82cb9c2a8eadd149a90ab9"
Oct 30 03:18:50.748956 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.748939    5068 scope.go:122] "RemoveContainer" containerID="039742e8cbbc7d7230ce2521d2b12e246c987571a76639ada0ab1ca270d12562"
Oct 30 03:18:50.755958 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.755937    5068 scope.go:122] "RemoveContainer" containerID="3202ac46491a277311a61f09dbce7a559f303e9df28eca889992fbcd0341bbfd"
Oct 30 03:18:50.762900 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.762883    5068 scope.go:122] "RemoveContainer" containerID="6450ae6c949b27d2c243d97d1d2826be2a7a43beab82cb9c2a8eadd149a90ab9"
Oct 30 03:18:50.763152 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:18:50.763133    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6450ae6c949b27d2c243d97d1d2826be2a7a43beab82cb9c2a8eadd149a90ab9\": container with ID starting with 6450ae6c949b27d2c243d97d1d2826be2a7a43beab82cb9c2a8eadd149a90ab9 not found: ID does not exist" containerID="6450ae6c949b27d2c243d97d1d2826be2a7a43beab82cb9c2a8eadd149a90ab9"
Oct 30 03:18:50.763198 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.763162    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6450ae6c949b27d2c243d97d1d2826be2a7a43beab82cb9c2a8eadd149a90ab9"} err="failed to get container status \"6450ae6c949b27d2c243d97d1d2826be2a7a43beab82cb9c2a8eadd149a90ab9\": rpc error: code = NotFound desc = could not find container \"6450ae6c949b27d2c243d97d1d2826be2a7a43beab82cb9c2a8eadd149a90ab9\": container with ID starting with 6450ae6c949b27d2c243d97d1d2826be2a7a43beab82cb9c2a8eadd149a90ab9 not found: ID does not exist"
Oct 30 03:18:50.763198 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.763179    5068 scope.go:122] "RemoveContainer" containerID="039742e8cbbc7d7230ce2521d2b12e246c987571a76639ada0ab1ca270d12562"
Oct 30 03:18:50.763414 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:18:50.763394    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"039742e8cbbc7d7230ce2521d2b12e246c987571a76639ada0ab1ca270d12562\": container with ID starting with 039742e8cbbc7d7230ce2521d2b12e246c987571a76639ada0ab1ca270d12562 not found: ID does not exist" containerID="039742e8cbbc7d7230ce2521d2b12e246c987571a76639ada0ab1ca270d12562"
Oct 30 03:18:50.763453 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.763421    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"039742e8cbbc7d7230ce2521d2b12e246c987571a76639ada0ab1ca270d12562"} err="failed to get container status \"039742e8cbbc7d7230ce2521d2b12e246c987571a76639ada0ab1ca270d12562\": rpc error: code = NotFound desc = could not find container \"039742e8cbbc7d7230ce2521d2b12e246c987571a76639ada0ab1ca270d12562\": container with ID starting with 039742e8cbbc7d7230ce2521d2b12e246c987571a76639ada0ab1ca270d12562 not found: ID does not exist"
Oct 30 03:18:50.763453 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.763435    5068 scope.go:122] "RemoveContainer" containerID="3202ac46491a277311a61f09dbce7a559f303e9df28eca889992fbcd0341bbfd"
Oct 30 03:18:50.763656 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:18:50.763640    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3202ac46491a277311a61f09dbce7a559f303e9df28eca889992fbcd0341bbfd\": container with ID starting with 3202ac46491a277311a61f09dbce7a559f303e9df28eca889992fbcd0341bbfd not found: ID does not exist" containerID="3202ac46491a277311a61f09dbce7a559f303e9df28eca889992fbcd0341bbfd"
Oct 30 03:18:50.763707 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.763659    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3202ac46491a277311a61f09dbce7a559f303e9df28eca889992fbcd0341bbfd"} err="failed to get container status \"3202ac46491a277311a61f09dbce7a559f303e9df28eca889992fbcd0341bbfd\": rpc error: code = NotFound desc = could not find container \"3202ac46491a277311a61f09dbce7a559f303e9df28eca889992fbcd0341bbfd\": container with ID starting with 3202ac46491a277311a61f09dbce7a559f303e9df28eca889992fbcd0341bbfd not found: ID does not exist"
Oct 30 03:18:50.791066 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.791043    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"]
Oct 30 03:18:50.799495 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:50.799470    5068 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-e6d7890379/isvc-sklearn-scale-raw-8f7bb-predictor-5d9b9d7889-hk6mn"]
Oct 30 03:18:51.071721 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:51.071626    5068 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" path="/var/lib/kubelet/pods/aaab928f-36b0-4219-a615-d1dee7b0319b/volumes"
Oct 30 03:18:51.211562 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:51.211525    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:18:54.543869 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:54.543788    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.40:8080: connect: connection refused"
Oct 30 03:18:56.268858 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:18:56.268804    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:19:04.544259 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:04.544220    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.40:8080: connect: connection refused"
Oct 30 03:19:07.283200 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:19:07.283159    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:19:14.544344 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:14.544314    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:19:33.137212 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:33.137177    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"]
Oct 30 03:19:33.137830 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:33.137471    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="kserve-container" containerID="cri-o://fb3d1acd1a8e09d2ff3b7e546b52e3ecbf8fb1f26a141f7fa1a8db35aace2974" gracePeriod=30
Oct 30 03:19:33.137830 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:33.137522    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="kube-rbac-proxy" containerID="cri-o://90ac0e5bbdbfabd4f3f7dd018c2a0963f10eef82436cc74d841b1ab76cc59efd" gracePeriod=30
Oct 30 03:19:33.232160 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:33.232131    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:19:33.400836 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:33.400680    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:19:33.568888 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:33.568844    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:19:33.747593 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:33.747494    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:19:33.907185 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:33.907152    5068 generic.go:356] "Generic (PLEG): container finished" podID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerID="90ac0e5bbdbfabd4f3f7dd018c2a0963f10eef82436cc74d841b1ab76cc59efd" exitCode=0
Oct 30 03:19:33.907343 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:33.907223    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" event={"ID":"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6","Type":"ContainerDied","Data":"90ac0e5bbdbfabd4f3f7dd018c2a0963f10eef82436cc74d841b1ab76cc59efd"}
Oct 30 03:19:33.928800 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:33.928753    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:19:34.098680 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:34.098588    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:19:34.538701 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:34.538643    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.40:8643/healthz\": dial tcp 10.132.0.40:8643: connect: connection refused"
Oct 30 03:19:34.544016 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:34.543983    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.40:8080: connect: connection refused"
Oct 30 03:19:35.380232 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:35.380200    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:19:35.573136 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:35.573098    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:19:37.281969 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:19:37.281934    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:19:37.765966 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.765939    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:19:37.924949 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.924868    5068 generic.go:356] "Generic (PLEG): container finished" podID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerID="fb3d1acd1a8e09d2ff3b7e546b52e3ecbf8fb1f26a141f7fa1a8db35aace2974" exitCode=0
Oct 30 03:19:37.924949 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.924922    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"
Oct 30 03:19:37.925125 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.924953    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" event={"ID":"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6","Type":"ContainerDied","Data":"fb3d1acd1a8e09d2ff3b7e546b52e3ecbf8fb1f26a141f7fa1a8db35aace2974"}
Oct 30 03:19:37.925125 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.925011    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk" event={"ID":"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6","Type":"ContainerDied","Data":"809d3e5d76fed334eecaed4eb19e3745f35d0891f09699ec76dd40c13db81aa7"}
Oct 30 03:19:37.925125 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.925038    5068 scope.go:122] "RemoveContainer" containerID="90ac0e5bbdbfabd4f3f7dd018c2a0963f10eef82436cc74d841b1ab76cc59efd"
Oct 30 03:19:37.933037 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.933000    5068 scope.go:122] "RemoveContainer" containerID="fb3d1acd1a8e09d2ff3b7e546b52e3ecbf8fb1f26a141f7fa1a8db35aace2974"
Oct 30 03:19:37.940452 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.940436    5068 scope.go:122] "RemoveContainer" containerID="490dd640b2c3bf4513c64ffd1018e07419cf844f9cd2e0442e3f5a30e8b942f6"
Oct 30 03:19:37.945475 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.945453    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-proxy-tls\" (UniqueName: \"kubernetes.io/secret/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-proxy-tls\") pod \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\" (UID: \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\") "
Oct 30 03:19:37.945564 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.945499    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kube-rbac-proxy-sar-config\") pod \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\" (UID: \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\") "
Oct 30 03:19:37.945564 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.945527    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-cabundle-cert\") pod \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\" (UID: \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\") "
Oct 30 03:19:37.945675 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.945568    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kserve-provision-location\") pod \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\" (UID: \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\") "
Oct 30 03:19:37.945675 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.945592    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kube-api-access-49vhf\" (UniqueName: \"kubernetes.io/projected/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kube-api-access-49vhf\") pod \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\" (UID: \"a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6\") "
Oct 30 03:19:37.945937 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.945909    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-cabundle-cert" pod "a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" (UID: "a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:19:37.945937 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.945930    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kube-rbac-proxy-sar-config" pod "a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" (UID: "a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:19:37.946082 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.945915    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kserve-provision-location" pod "a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" (UID: "a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:19:37.947427 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.947408    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-proxy-tls" pod "a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" (UID: "a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:19:37.948128 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.948110    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kube-api-access-49vhf" pod "a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" (UID: "a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6"). InnerVolumeSpecName "kube-api-access-49vhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:19:37.948603 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.948585    5068 scope.go:122] "RemoveContainer" containerID="90ac0e5bbdbfabd4f3f7dd018c2a0963f10eef82436cc74d841b1ab76cc59efd"
Oct 30 03:19:37.948899 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:19:37.948873    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90ac0e5bbdbfabd4f3f7dd018c2a0963f10eef82436cc74d841b1ab76cc59efd\": container with ID starting with 90ac0e5bbdbfabd4f3f7dd018c2a0963f10eef82436cc74d841b1ab76cc59efd not found: ID does not exist" containerID="90ac0e5bbdbfabd4f3f7dd018c2a0963f10eef82436cc74d841b1ab76cc59efd"
Oct 30 03:19:37.948952 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.948911    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90ac0e5bbdbfabd4f3f7dd018c2a0963f10eef82436cc74d841b1ab76cc59efd"} err="failed to get container status \"90ac0e5bbdbfabd4f3f7dd018c2a0963f10eef82436cc74d841b1ab76cc59efd\": rpc error: code = NotFound desc = could not find container \"90ac0e5bbdbfabd4f3f7dd018c2a0963f10eef82436cc74d841b1ab76cc59efd\": container with ID starting with 90ac0e5bbdbfabd4f3f7dd018c2a0963f10eef82436cc74d841b1ab76cc59efd not found: ID does not exist"
Oct 30 03:19:37.948952 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.948934    5068 scope.go:122] "RemoveContainer" containerID="fb3d1acd1a8e09d2ff3b7e546b52e3ecbf8fb1f26a141f7fa1a8db35aace2974"
Oct 30 03:19:37.949191 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:19:37.949173    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb3d1acd1a8e09d2ff3b7e546b52e3ecbf8fb1f26a141f7fa1a8db35aace2974\": container with ID starting with fb3d1acd1a8e09d2ff3b7e546b52e3ecbf8fb1f26a141f7fa1a8db35aace2974 not found: ID does not exist" containerID="fb3d1acd1a8e09d2ff3b7e546b52e3ecbf8fb1f26a141f7fa1a8db35aace2974"
Oct 30 03:19:37.949242 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.949196    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb3d1acd1a8e09d2ff3b7e546b52e3ecbf8fb1f26a141f7fa1a8db35aace2974"} err="failed to get container status \"fb3d1acd1a8e09d2ff3b7e546b52e3ecbf8fb1f26a141f7fa1a8db35aace2974\": rpc error: code = NotFound desc = could not find container \"fb3d1acd1a8e09d2ff3b7e546b52e3ecbf8fb1f26a141f7fa1a8db35aace2974\": container with ID starting with fb3d1acd1a8e09d2ff3b7e546b52e3ecbf8fb1f26a141f7fa1a8db35aace2974 not found: ID does not exist"
Oct 30 03:19:37.949242 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.949212    5068 scope.go:122] "RemoveContainer" containerID="490dd640b2c3bf4513c64ffd1018e07419cf844f9cd2e0442e3f5a30e8b942f6"
Oct 30 03:19:37.949452 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:19:37.949436    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"490dd640b2c3bf4513c64ffd1018e07419cf844f9cd2e0442e3f5a30e8b942f6\": container with ID starting with 490dd640b2c3bf4513c64ffd1018e07419cf844f9cd2e0442e3f5a30e8b942f6 not found: ID does not exist" containerID="490dd640b2c3bf4513c64ffd1018e07419cf844f9cd2e0442e3f5a30e8b942f6"
Oct 30 03:19:37.949494 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:37.949457    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"490dd640b2c3bf4513c64ffd1018e07419cf844f9cd2e0442e3f5a30e8b942f6"} err="failed to get container status \"490dd640b2c3bf4513c64ffd1018e07419cf844f9cd2e0442e3f5a30e8b942f6\": rpc error: code = NotFound desc = could not find container \"490dd640b2c3bf4513c64ffd1018e07419cf844f9cd2e0442e3f5a30e8b942f6\": container with ID starting with 490dd640b2c3bf4513c64ffd1018e07419cf844f9cd2e0442e3f5a30e8b942f6 not found: ID does not exist"
Oct 30 03:19:38.046633 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:38.046608    5068 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:19:38.046633 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:38.046631    5068 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-cabundle-cert\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:19:38.046799 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:38.046640    5068 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kserve-provision-location\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:19:38.046799 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:38.046649    5068 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49vhf\" (UniqueName: \"kubernetes.io/projected/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-kube-api-access-49vhf\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:19:38.046799 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:38.046659    5068 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6-proxy-tls\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:19:38.265875 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:38.265852    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"]
Oct 30 03:19:38.273922 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:38.273901    5068 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-create-predictor-57bc666c8b-68snk"]
Oct 30 03:19:39.070914 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:39.070880    5068 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" path="/var/lib/kubelet/pods/a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6/volumes"
Oct 30 03:19:40.877598 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:40.877558    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:19:41.063290 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.063258    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:19:41.121511 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.121480    5068 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"]
Oct 30 03:19:41.121809 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.121795    5068 cpu_manager.go:414] "containerMap: removing container" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="kube-rbac-proxy"
Oct 30 03:19:41.121855 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.121811    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="kube-rbac-proxy"
Oct 30 03:19:41.121855 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.121827    5068 cpu_manager.go:414] "containerMap: removing container" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="kserve-container"
Oct 30 03:19:41.121855 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.121833    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="kserve-container"
Oct 30 03:19:41.121855 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.121847    5068 cpu_manager.go:414] "containerMap: removing container" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container"
Oct 30 03:19:41.121855 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.121854    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container"
Oct 30 03:19:41.122022 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.121861    5068 cpu_manager.go:414] "containerMap: removing container" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="storage-initializer"
Oct 30 03:19:41.122022 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.121865    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="storage-initializer"
Oct 30 03:19:41.122022 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.121877    5068 cpu_manager.go:414] "containerMap: removing container" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kube-rbac-proxy"
Oct 30 03:19:41.122022 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.121882    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kube-rbac-proxy"
Oct 30 03:19:41.122022 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.121893    5068 cpu_manager.go:414] "containerMap: removing container" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="storage-initializer"
Oct 30 03:19:41.122022 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.121900    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="storage-initializer"
Oct 30 03:19:41.122022 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.121998    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="kube-rbac-proxy"
Oct 30 03:19:41.122022 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.122006    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="a999faf3-3c91-41e0-b8b9-7e7cc7df9cc6" containerName="kserve-container"
Oct 30 03:19:41.122022 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.122014    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kserve-container"
Oct 30 03:19:41.122022 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.122021    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="aaab928f-36b0-4219-a615-d1dee7b0319b" containerName="kube-rbac-proxy"
Oct 30 03:19:41.127161 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.127140    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:19:41.151695 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.151670    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"]
Oct 30 03:19:41.169448 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.169415    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ec0ba74f-c555-4ef9-85c4-e89d64a39702-cabundle-cert\") pod \"isvc-canary-promote-predictor-57ffc5b69d-n2jf8\" (UID: \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:19:41.169565 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.169464    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ec0ba74f-c555-4ef9-85c4-e89d64a39702-proxy-tls\") pod \"isvc-canary-promote-predictor-57ffc5b69d-n2jf8\" (UID: \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:19:41.169565 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.169533    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kserve-provision-location\") pod \"isvc-canary-promote-predictor-57ffc5b69d-n2jf8\" (UID: \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:19:41.169655 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.169605    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt5gd\" (UniqueName: \"kubernetes.io/projected/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kube-api-access-zt5gd\") pod \"isvc-canary-promote-predictor-57ffc5b69d-n2jf8\" (UID: \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:19:41.169655 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.169634    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-57ffc5b69d-n2jf8\" (UID: \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:19:41.217855 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.217833    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"isvc-canary-promote-predictor-serving-cert\""
Oct 30 03:19:41.218179 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.218163    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"seaweedfs-s3-creds\""
Oct 30 03:19:41.218255 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.218219    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"default-dockercfg-57rzd\""
Oct 30 03:19:41.218586 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.218569    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"openshift-service-ca.crt\""
Oct 30 03:19:41.218658 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.218638    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"isvc-canary-promote-kube-rbac-proxy-sar-config\""
Oct 30 03:19:41.218718 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.218677    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"kube-root-ca.crt\""
Oct 30 03:19:41.219342 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.219326    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 03:19:41.238960 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.238933    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:19:41.269951 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.269929    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt5gd\" (UniqueName: \"kubernetes.io/projected/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kube-api-access-zt5gd\") pod \"isvc-canary-promote-predictor-57ffc5b69d-n2jf8\" (UID: \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:19:41.270039 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.269960    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-57ffc5b69d-n2jf8\" (UID: \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:19:41.270039 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.269987    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ec0ba74f-c555-4ef9-85c4-e89d64a39702-cabundle-cert\") pod \"isvc-canary-promote-predictor-57ffc5b69d-n2jf8\" (UID: \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:19:41.270039 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.270026    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ec0ba74f-c555-4ef9-85c4-e89d64a39702-proxy-tls\") pod \"isvc-canary-promote-predictor-57ffc5b69d-n2jf8\" (UID: \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:19:41.270193 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.270051    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kserve-provision-location\") pod \"isvc-canary-promote-predictor-57ffc5b69d-n2jf8\" (UID: \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:19:41.270475 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.270455    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kserve-provision-location\") pod \"isvc-canary-promote-predictor-57ffc5b69d-n2jf8\" (UID: \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:19:41.270675 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.270651    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-57ffc5b69d-n2jf8\" (UID: \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:19:41.270792 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.270717    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ec0ba74f-c555-4ef9-85c4-e89d64a39702-cabundle-cert\") pod \"isvc-canary-promote-predictor-57ffc5b69d-n2jf8\" (UID: \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:19:41.272498 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.272480    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ec0ba74f-c555-4ef9-85c4-e89d64a39702-proxy-tls\") pod \"isvc-canary-promote-predictor-57ffc5b69d-n2jf8\" (UID: \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:19:41.298627 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.298596    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt5gd\" (UniqueName: \"kubernetes.io/projected/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kube-api-access-zt5gd\") pod \"isvc-canary-promote-predictor-57ffc5b69d-n2jf8\" (UID: \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:19:41.443908 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.443855    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:19:41.758152 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.758075    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"]
Oct 30 03:19:41.763208 ip-10-0-139-40 kubenswrapper[5068]: W1030 03:19:41.763179    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec0ba74f_c555_4ef9_85c4_e89d64a39702.slice/crio-9316cc4bdecfc2162b34cf3501508b33973c8c6988d108c7f778eba2eed5eef0 WatchSource:0}: Error finding container 9316cc4bdecfc2162b34cf3501508b33973c8c6988d108c7f778eba2eed5eef0: Status 404 returned error can't find the container with id 9316cc4bdecfc2162b34cf3501508b33973c8c6988d108c7f778eba2eed5eef0
Oct 30 03:19:41.943523 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.943491    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" event={"ID":"ec0ba74f-c555-4ef9-85c4-e89d64a39702","Type":"ContainerStarted","Data":"d3e8a035443c424a798eb9b95758d3e5495ecadc7521c8dbcf41e2dc25e32bf8"}
Oct 30 03:19:41.943898 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:41.943558    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" event={"ID":"ec0ba74f-c555-4ef9-85c4-e89d64a39702","Type":"ContainerStarted","Data":"9316cc4bdecfc2162b34cf3501508b33973c8c6988d108c7f778eba2eed5eef0"}
Oct 30 03:19:42.036564 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:42.036492    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:19:42.211725 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:42.211678    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:19:45.961473 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:45.961443    5068 generic.go:356] "Generic (PLEG): container finished" podID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerID="d3e8a035443c424a798eb9b95758d3e5495ecadc7521c8dbcf41e2dc25e32bf8" exitCode=0
Oct 30 03:19:45.961876 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:45.961483    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" event={"ID":"ec0ba74f-c555-4ef9-85c4-e89d64a39702","Type":"ContainerDied","Data":"d3e8a035443c424a798eb9b95758d3e5495ecadc7521c8dbcf41e2dc25e32bf8"}
Oct 30 03:19:46.967672 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:46.967640    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" event={"ID":"ec0ba74f-c555-4ef9-85c4-e89d64a39702","Type":"ContainerStarted","Data":"2df9d183516de54422c39b73b37c1f0b6c85cdcd5aa31f8f1347240b3b57e826"}
Oct 30 03:19:46.968077 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:46.967710    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" event={"ID":"ec0ba74f-c555-4ef9-85c4-e89d64a39702","Type":"ContainerStarted","Data":"582cf6b1b3d8be9d0249e41894b2d4fa92b7f1f8edd9105dc85fd3497d107c6e"}
Oct 30 03:19:46.968077 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:46.967891    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:19:47.019228 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:47.019189    5068 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" podStartSLOduration=2.272773701 podStartE2EDuration="6.01917708s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.746403379s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:19:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:19:47.018359905 +0000 UTC m=+1444.093730115" watchObservedRunningTime="2026-10-30 03:19:47.01917708 +0000 UTC m=+1444.094547290"
Oct 30 03:19:47.971577 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:47.971543    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:19:47.972792 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:47.972759    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Oct 30 03:19:48.975810 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:48.975769    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Oct 30 03:19:53.980742 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:53.980710    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:19:53.981286 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:19:53.981260    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Oct 30 03:20:03.981273 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:20:03.981235    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Oct 30 03:20:07.280987 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:20:07.280942    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:20:13.981518 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:20:13.981479    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Oct 30 03:20:23.982104 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:20:23.982065    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Oct 30 03:20:33.981436 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:20:33.981350    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Oct 30 03:20:37.090820 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:20:37.090779    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:20:37.280873 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:20:37.280827    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:20:43.195211 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:20:43.195185    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/1.log"
Oct 30 03:20:43.198294 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:20:43.198274    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/1.log"
Oct 30 03:20:43.981589 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:20:43.981540    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Oct 30 03:20:53.981593 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:20:53.981555    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Oct 30 03:21:00.066771 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:00.066730    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Oct 30 03:21:07.282494 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:21:07.282454    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:21:07.486480 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:07.486443    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"]
Oct 30 03:21:07.486734 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:07.486704    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="kserve-container" containerID="cri-o://582cf6b1b3d8be9d0249e41894b2d4fa92b7f1f8edd9105dc85fd3497d107c6e" gracePeriod=30
Oct 30 03:21:07.486896 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:07.486758    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="kube-rbac-proxy" containerID="cri-o://2df9d183516de54422c39b73b37c1f0b6c85cdcd5aa31f8f1347240b3b57e826" gracePeriod=30
Oct 30 03:21:07.487916 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:07.487888    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:21:08.281775 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:08.281744    5068 generic.go:356] "Generic (PLEG): container finished" podID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerID="2df9d183516de54422c39b73b37c1f0b6c85cdcd5aa31f8f1347240b3b57e826" exitCode=0
Oct 30 03:21:08.281934 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:08.281798    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" event={"ID":"ec0ba74f-c555-4ef9-85c4-e89d64a39702","Type":"ContainerDied","Data":"2df9d183516de54422c39b73b37c1f0b6c85cdcd5aa31f8f1347240b3b57e826"}
Oct 30 03:21:08.976832 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:08.976787    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.41:8643/healthz\": dial tcp 10.132.0.41:8643: connect: connection refused"
Oct 30 03:21:12.029303 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.029275    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:21:12.041600 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.041576    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ec0ba74f-c555-4ef9-85c4-e89d64a39702-proxy-tls\" (UniqueName: \"kubernetes.io/secret/ec0ba74f-c555-4ef9-85c4-e89d64a39702-proxy-tls\") pod \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\" (UID: \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\") "
Oct 30 03:21:12.041733 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.041624    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kube-rbac-proxy-sar-config\") pod \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\" (UID: \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\") "
Oct 30 03:21:12.041733 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.041660    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kserve-provision-location\") pod \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\" (UID: \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\") "
Oct 30 03:21:12.041869 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.041786    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ec0ba74f-c555-4ef9-85c4-e89d64a39702-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ec0ba74f-c555-4ef9-85c4-e89d64a39702-cabundle-cert\") pod \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\" (UID: \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\") "
Oct 30 03:21:12.041869 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.041846    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kube-api-access-zt5gd\" (UniqueName: \"kubernetes.io/projected/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kube-api-access-zt5gd\") pod \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\" (UID: \"ec0ba74f-c555-4ef9-85c4-e89d64a39702\") "
Oct 30 03:21:12.041993 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.041971    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kserve-provision-location" pod "ec0ba74f-c555-4ef9-85c4-e89d64a39702" (UID: "ec0ba74f-c555-4ef9-85c4-e89d64a39702"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:21:12.042124 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.042098    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kube-rbac-proxy-sar-config" pod "ec0ba74f-c555-4ef9-85c4-e89d64a39702" (UID: "ec0ba74f-c555-4ef9-85c4-e89d64a39702"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:21:12.042223 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.042175    5068 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:21:12.042223 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.042180    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec0ba74f-c555-4ef9-85c4-e89d64a39702-cabundle-cert" pod "ec0ba74f-c555-4ef9-85c4-e89d64a39702" (UID: "ec0ba74f-c555-4ef9-85c4-e89d64a39702"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:21:12.042223 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.042189    5068 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kserve-provision-location\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:21:12.043637 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.043616    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec0ba74f-c555-4ef9-85c4-e89d64a39702-proxy-tls" pod "ec0ba74f-c555-4ef9-85c4-e89d64a39702" (UID: "ec0ba74f-c555-4ef9-85c4-e89d64a39702"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:21:12.043764 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.043745    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kube-api-access-zt5gd" pod "ec0ba74f-c555-4ef9-85c4-e89d64a39702" (UID: "ec0ba74f-c555-4ef9-85c4-e89d64a39702"). InnerVolumeSpecName "kube-api-access-zt5gd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:21:12.143454 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.143417    5068 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ec0ba74f-c555-4ef9-85c4-e89d64a39702-proxy-tls\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:21:12.143616 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.143485    5068 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ec0ba74f-c555-4ef9-85c4-e89d64a39702-cabundle-cert\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:21:12.143676 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.143641    5068 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt5gd\" (UniqueName: \"kubernetes.io/projected/ec0ba74f-c555-4ef9-85c4-e89d64a39702-kube-api-access-zt5gd\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:21:12.300725 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.300695    5068 generic.go:356] "Generic (PLEG): container finished" podID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerID="582cf6b1b3d8be9d0249e41894b2d4fa92b7f1f8edd9105dc85fd3497d107c6e" exitCode=0
Oct 30 03:21:12.300895 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.300741    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" event={"ID":"ec0ba74f-c555-4ef9-85c4-e89d64a39702","Type":"ContainerDied","Data":"582cf6b1b3d8be9d0249e41894b2d4fa92b7f1f8edd9105dc85fd3497d107c6e"}
Oct 30 03:21:12.300895 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.300760    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"
Oct 30 03:21:12.300895 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.300789    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8" event={"ID":"ec0ba74f-c555-4ef9-85c4-e89d64a39702","Type":"ContainerDied","Data":"9316cc4bdecfc2162b34cf3501508b33973c8c6988d108c7f778eba2eed5eef0"}
Oct 30 03:21:12.300895 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.300816    5068 scope.go:122] "RemoveContainer" containerID="2df9d183516de54422c39b73b37c1f0b6c85cdcd5aa31f8f1347240b3b57e826"
Oct 30 03:21:12.309446 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.309430    5068 scope.go:122] "RemoveContainer" containerID="582cf6b1b3d8be9d0249e41894b2d4fa92b7f1f8edd9105dc85fd3497d107c6e"
Oct 30 03:21:12.316644 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.316624    5068 scope.go:122] "RemoveContainer" containerID="d3e8a035443c424a798eb9b95758d3e5495ecadc7521c8dbcf41e2dc25e32bf8"
Oct 30 03:21:12.324912 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.324894    5068 scope.go:122] "RemoveContainer" containerID="2df9d183516de54422c39b73b37c1f0b6c85cdcd5aa31f8f1347240b3b57e826"
Oct 30 03:21:12.325277 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:21:12.325256    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2df9d183516de54422c39b73b37c1f0b6c85cdcd5aa31f8f1347240b3b57e826\": container with ID starting with 2df9d183516de54422c39b73b37c1f0b6c85cdcd5aa31f8f1347240b3b57e826 not found: ID does not exist" containerID="2df9d183516de54422c39b73b37c1f0b6c85cdcd5aa31f8f1347240b3b57e826"
Oct 30 03:21:12.325359 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.325289    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2df9d183516de54422c39b73b37c1f0b6c85cdcd5aa31f8f1347240b3b57e826"} err="failed to get container status \"2df9d183516de54422c39b73b37c1f0b6c85cdcd5aa31f8f1347240b3b57e826\": rpc error: code = NotFound desc = could not find container \"2df9d183516de54422c39b73b37c1f0b6c85cdcd5aa31f8f1347240b3b57e826\": container with ID starting with 2df9d183516de54422c39b73b37c1f0b6c85cdcd5aa31f8f1347240b3b57e826 not found: ID does not exist"
Oct 30 03:21:12.325359 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.325307    5068 scope.go:122] "RemoveContainer" containerID="582cf6b1b3d8be9d0249e41894b2d4fa92b7f1f8edd9105dc85fd3497d107c6e"
Oct 30 03:21:12.325580 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:21:12.325563    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"582cf6b1b3d8be9d0249e41894b2d4fa92b7f1f8edd9105dc85fd3497d107c6e\": container with ID starting with 582cf6b1b3d8be9d0249e41894b2d4fa92b7f1f8edd9105dc85fd3497d107c6e not found: ID does not exist" containerID="582cf6b1b3d8be9d0249e41894b2d4fa92b7f1f8edd9105dc85fd3497d107c6e"
Oct 30 03:21:12.325633 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.325587    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"582cf6b1b3d8be9d0249e41894b2d4fa92b7f1f8edd9105dc85fd3497d107c6e"} err="failed to get container status \"582cf6b1b3d8be9d0249e41894b2d4fa92b7f1f8edd9105dc85fd3497d107c6e\": rpc error: code = NotFound desc = could not find container \"582cf6b1b3d8be9d0249e41894b2d4fa92b7f1f8edd9105dc85fd3497d107c6e\": container with ID starting with 582cf6b1b3d8be9d0249e41894b2d4fa92b7f1f8edd9105dc85fd3497d107c6e not found: ID does not exist"
Oct 30 03:21:12.325633 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.325603    5068 scope.go:122] "RemoveContainer" containerID="d3e8a035443c424a798eb9b95758d3e5495ecadc7521c8dbcf41e2dc25e32bf8"
Oct 30 03:21:12.325876 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:21:12.325860    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3e8a035443c424a798eb9b95758d3e5495ecadc7521c8dbcf41e2dc25e32bf8\": container with ID starting with d3e8a035443c424a798eb9b95758d3e5495ecadc7521c8dbcf41e2dc25e32bf8 not found: ID does not exist" containerID="d3e8a035443c424a798eb9b95758d3e5495ecadc7521c8dbcf41e2dc25e32bf8"
Oct 30 03:21:12.325930 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.325885    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3e8a035443c424a798eb9b95758d3e5495ecadc7521c8dbcf41e2dc25e32bf8"} err="failed to get container status \"d3e8a035443c424a798eb9b95758d3e5495ecadc7521c8dbcf41e2dc25e32bf8\": rpc error: code = NotFound desc = could not find container \"d3e8a035443c424a798eb9b95758d3e5495ecadc7521c8dbcf41e2dc25e32bf8\": container with ID starting with d3e8a035443c424a798eb9b95758d3e5495ecadc7521c8dbcf41e2dc25e32bf8 not found: ID does not exist"
Oct 30 03:21:12.347442 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.347419    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"]
Oct 30 03:21:12.350836 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:12.350817    5068 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-promote-predictor-57ffc5b69d-n2jf8"]
Oct 30 03:21:13.070415 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:13.070374    5068 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" path="/var/lib/kubelet/pods/ec0ba74f-c555-4ef9-85c4-e89d64a39702/volumes"
Oct 30 03:21:21.372624 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.372588    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:21:21.421772 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.421741    5068 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"]
Oct 30 03:21:21.422053 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.422041    5068 cpu_manager.go:414] "containerMap: removing container" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="storage-initializer"
Oct 30 03:21:21.422095 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.422055    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="storage-initializer"
Oct 30 03:21:21.422095 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.422066    5068 cpu_manager.go:414] "containerMap: removing container" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="kube-rbac-proxy"
Oct 30 03:21:21.422095 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.422071    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="kube-rbac-proxy"
Oct 30 03:21:21.422095 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.422080    5068 cpu_manager.go:414] "containerMap: removing container" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="kserve-container"
Oct 30 03:21:21.422095 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.422085    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="kserve-container"
Oct 30 03:21:21.422255 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.422152    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="kube-rbac-proxy"
Oct 30 03:21:21.422255 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.422160    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="ec0ba74f-c555-4ef9-85c4-e89d64a39702" containerName="kserve-container"
Oct 30 03:21:21.427066 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.427047    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:21:21.450630 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.450608    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"isvc-canary-promote-kube-rbac-proxy-sar-config\""
Oct 30 03:21:21.450794 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.450609    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"seaweedfs-s3-creds\""
Oct 30 03:21:21.450905 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.450616    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 03:21:21.450905 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.450628    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"default-dockercfg-57rzd\""
Oct 30 03:21:21.450905 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.450709    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"kube-root-ca.crt\""
Oct 30 03:21:21.450905 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.450737    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-d44ea3c803\"/\"isvc-canary-promote-v2-predictor-serving-cert\""
Oct 30 03:21:21.450905 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.450776    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-d44ea3c803\"/\"openshift-service-ca.crt\""
Oct 30 03:21:21.452120 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.452102    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"]
Oct 30 03:21:21.512126 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.512087    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wxtv\" (UniqueName: \"kubernetes.io/projected/8fe62b4e-db53-4520-a9f3-87a42c19590d-kube-api-access-9wxtv\") pod \"isvc-canary-promote-v2-predictor-788cb55695-kg7zg\" (UID: \"8fe62b4e-db53-4520-a9f3-87a42c19590d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:21:21.512241 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.512143    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8fe62b4e-db53-4520-a9f3-87a42c19590d-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-788cb55695-kg7zg\" (UID: \"8fe62b4e-db53-4520-a9f3-87a42c19590d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:21:21.512241 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.512221    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8fe62b4e-db53-4520-a9f3-87a42c19590d-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-788cb55695-kg7zg\" (UID: \"8fe62b4e-db53-4520-a9f3-87a42c19590d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:21:21.512335 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.512256    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8fe62b4e-db53-4520-a9f3-87a42c19590d-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-788cb55695-kg7zg\" (UID: \"8fe62b4e-db53-4520-a9f3-87a42c19590d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:21:21.512369 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.512338    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8fe62b4e-db53-4520-a9f3-87a42c19590d-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-788cb55695-kg7zg\" (UID: \"8fe62b4e-db53-4520-a9f3-87a42c19590d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:21:21.613431 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.613407    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8fe62b4e-db53-4520-a9f3-87a42c19590d-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-788cb55695-kg7zg\" (UID: \"8fe62b4e-db53-4520-a9f3-87a42c19590d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:21:21.613547 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.613444    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wxtv\" (UniqueName: \"kubernetes.io/projected/8fe62b4e-db53-4520-a9f3-87a42c19590d-kube-api-access-9wxtv\") pod \"isvc-canary-promote-v2-predictor-788cb55695-kg7zg\" (UID: \"8fe62b4e-db53-4520-a9f3-87a42c19590d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:21:21.613547 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.613469    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8fe62b4e-db53-4520-a9f3-87a42c19590d-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-788cb55695-kg7zg\" (UID: \"8fe62b4e-db53-4520-a9f3-87a42c19590d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:21:21.613547 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.613495    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8fe62b4e-db53-4520-a9f3-87a42c19590d-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-788cb55695-kg7zg\" (UID: \"8fe62b4e-db53-4520-a9f3-87a42c19590d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:21:21.613547 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.613523    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8fe62b4e-db53-4520-a9f3-87a42c19590d-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-788cb55695-kg7zg\" (UID: \"8fe62b4e-db53-4520-a9f3-87a42c19590d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:21:21.614004 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.613978    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8fe62b4e-db53-4520-a9f3-87a42c19590d-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-788cb55695-kg7zg\" (UID: \"8fe62b4e-db53-4520-a9f3-87a42c19590d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:21:21.614126 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.614109    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8fe62b4e-db53-4520-a9f3-87a42c19590d-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-788cb55695-kg7zg\" (UID: \"8fe62b4e-db53-4520-a9f3-87a42c19590d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:21:21.614218 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.614200    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8fe62b4e-db53-4520-a9f3-87a42c19590d-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-788cb55695-kg7zg\" (UID: \"8fe62b4e-db53-4520-a9f3-87a42c19590d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:21:21.615853 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.615829    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8fe62b4e-db53-4520-a9f3-87a42c19590d-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-788cb55695-kg7zg\" (UID: \"8fe62b4e-db53-4520-a9f3-87a42c19590d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:21:21.636032 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.635986    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wxtv\" (UniqueName: \"kubernetes.io/projected/8fe62b4e-db53-4520-a9f3-87a42c19590d-kube-api-access-9wxtv\") pod \"isvc-canary-promote-v2-predictor-788cb55695-kg7zg\" (UID: \"8fe62b4e-db53-4520-a9f3-87a42c19590d\") " pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:21:21.743246 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:21.743223    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:21:22.055953 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:22.055884    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"]
Oct 30 03:21:22.061012 ip-10-0-139-40 kubenswrapper[5068]: W1030 03:21:22.060984    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe62b4e_db53_4520_a9f3_87a42c19590d.slice/crio-c13951e9fa01147df4c0e2d71e9748df413ae7779dea378dd9e6e5b2a463134c WatchSource:0}: Error finding container c13951e9fa01147df4c0e2d71e9748df413ae7779dea378dd9e6e5b2a463134c: Status 404 returned error can't find the container with id c13951e9fa01147df4c0e2d71e9748df413ae7779dea378dd9e6e5b2a463134c
Oct 30 03:21:22.341398 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:22.341315    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" event={"ID":"8fe62b4e-db53-4520-a9f3-87a42c19590d","Type":"ContainerStarted","Data":"24e3d96dd42bedf850b0ebf7364d63ecbf44d376b74d2127780cdb2e1e902466"}
Oct 30 03:21:22.341398 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:22.341372    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" event={"ID":"8fe62b4e-db53-4520-a9f3-87a42c19590d","Type":"ContainerStarted","Data":"c13951e9fa01147df4c0e2d71e9748df413ae7779dea378dd9e6e5b2a463134c"}
Oct 30 03:21:26.358348 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:26.358259    5068 generic.go:356] "Generic (PLEG): container finished" podID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerID="24e3d96dd42bedf850b0ebf7364d63ecbf44d376b74d2127780cdb2e1e902466" exitCode=0
Oct 30 03:21:26.358348 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:26.358314    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" event={"ID":"8fe62b4e-db53-4520-a9f3-87a42c19590d","Type":"ContainerDied","Data":"24e3d96dd42bedf850b0ebf7364d63ecbf44d376b74d2127780cdb2e1e902466"}
Oct 30 03:21:27.364452 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:27.364417    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" event={"ID":"8fe62b4e-db53-4520-a9f3-87a42c19590d","Type":"ContainerStarted","Data":"2c37cd89e45ae642d6f7c1f5fa0702a5c8134f3e763ed18a1f570b2d134f4eb9"}
Oct 30 03:21:27.364870 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:27.364480    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" event={"ID":"8fe62b4e-db53-4520-a9f3-87a42c19590d","Type":"ContainerStarted","Data":"a5fdeba7384f4640469ecae3bd739af506115dc125ee0aef598c12b51e79fa4e"}
Oct 30 03:21:27.364870 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:27.364701    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:21:27.415940 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:27.415883    5068 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" podStartSLOduration=2.514988844 podStartE2EDuration="6.415870541s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.900881697s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:21:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:21:27.414834934 +0000 UTC m=+1544.490205145" watchObservedRunningTime="2026-10-30 03:21:27.415870541 +0000 UTC m=+1544.491240749"
Oct 30 03:21:28.368564 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:28.368534    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:21:28.369729 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:28.369702    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused"
Oct 30 03:21:29.372979 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:29.372944    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused"
Oct 30 03:21:34.377905 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:34.377876    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:21:34.378369 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:34.378345    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused"
Oct 30 03:21:35.646534 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:35.646498    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:21:37.281169 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:21:37.281124    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:21:44.378967 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:44.378928    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused"
Oct 30 03:21:54.379057 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:21:54.379021    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused"
Oct 30 03:22:04.379170 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:22:04.379129    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused"
Oct 30 03:22:06.455063 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:22:06.455026    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:22:07.281020 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:22:07.280986    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:22:14.378406 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:22:14.378367    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused"
Oct 30 03:22:24.378382 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:22:24.378338    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused"
Oct 30 03:22:34.378984 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:22:34.378943    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused"
Oct 30 03:22:35.754125 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:22:35.754089    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:22:37.065906 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:22:37.065866    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused"
Oct 30 03:22:37.281233 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:22:37.281199    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:22:47.071376 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:22:47.071343    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:22:51.842886 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:22:51.842857    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"]
Oct 30 03:22:51.843280 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:22:51.843109    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kserve-container" containerID="cri-o://a5fdeba7384f4640469ecae3bd739af506115dc125ee0aef598c12b51e79fa4e" gracePeriod=30
Oct 30 03:22:51.843280 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:22:51.843111    5068 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kube-rbac-proxy" containerID="cri-o://2c37cd89e45ae642d6f7c1f5fa0702a5c8134f3e763ed18a1f570b2d134f4eb9" gracePeriod=30
Oct 30 03:22:51.949723 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:22:51.949665    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:22:52.696991 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:22:52.696960    5068 generic.go:356] "Generic (PLEG): container finished" podID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerID="2c37cd89e45ae642d6f7c1f5fa0702a5c8134f3e763ed18a1f570b2d134f4eb9" exitCode=0
Oct 30 03:22:52.697170 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:22:52.697033    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" event={"ID":"8fe62b4e-db53-4520-a9f3-87a42c19590d","Type":"ContainerDied","Data":"2c37cd89e45ae642d6f7c1f5fa0702a5c8134f3e763ed18a1f570b2d134f4eb9"}
Oct 30 03:22:54.373457 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:22:54.373420    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.42:8643/healthz\": dial tcp 10.132.0.42:8643: connect: connection refused"
Oct 30 03:22:57.066384 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:22:57.066341    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.42:8080: connect: connection refused"
Oct 30 03:22:59.373772 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:22:59.373727    5068 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.42:8643/healthz\": dial tcp 10.132.0.42:8643: connect: connection refused"
Oct 30 03:22:59.982573 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:22:59.982548    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:23:00.069637 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.069606    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8fe62b4e-db53-4520-a9f3-87a42c19590d-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8fe62b4e-db53-4520-a9f3-87a42c19590d-kube-rbac-proxy-sar-config\") pod \"8fe62b4e-db53-4520-a9f3-87a42c19590d\" (UID: \"8fe62b4e-db53-4520-a9f3-87a42c19590d\") "
Oct 30 03:23:00.069637 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.069644    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8fe62b4e-db53-4520-a9f3-87a42c19590d-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8fe62b4e-db53-4520-a9f3-87a42c19590d-kserve-provision-location\") pod \"8fe62b4e-db53-4520-a9f3-87a42c19590d\" (UID: \"8fe62b4e-db53-4520-a9f3-87a42c19590d\") "
Oct 30 03:23:00.069879 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.069669    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8fe62b4e-db53-4520-a9f3-87a42c19590d-proxy-tls\" (UniqueName: \"kubernetes.io/secret/8fe62b4e-db53-4520-a9f3-87a42c19590d-proxy-tls\") pod \"8fe62b4e-db53-4520-a9f3-87a42c19590d\" (UID: \"8fe62b4e-db53-4520-a9f3-87a42c19590d\") "
Oct 30 03:23:00.069879 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.069731    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8fe62b4e-db53-4520-a9f3-87a42c19590d-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8fe62b4e-db53-4520-a9f3-87a42c19590d-cabundle-cert\") pod \"8fe62b4e-db53-4520-a9f3-87a42c19590d\" (UID: \"8fe62b4e-db53-4520-a9f3-87a42c19590d\") "
Oct 30 03:23:00.069879 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.069773    5068 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8fe62b4e-db53-4520-a9f3-87a42c19590d-kube-api-access-9wxtv\" (UniqueName: \"kubernetes.io/projected/8fe62b4e-db53-4520-a9f3-87a42c19590d-kube-api-access-9wxtv\") pod \"8fe62b4e-db53-4520-a9f3-87a42c19590d\" (UID: \"8fe62b4e-db53-4520-a9f3-87a42c19590d\") "
Oct 30 03:23:00.070040 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.070019    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fe62b4e-db53-4520-a9f3-87a42c19590d-kserve-provision-location" pod "8fe62b4e-db53-4520-a9f3-87a42c19590d" (UID: "8fe62b4e-db53-4520-a9f3-87a42c19590d"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:23:00.070126 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.070100    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fe62b4e-db53-4520-a9f3-87a42c19590d-kube-rbac-proxy-sar-config" pod "8fe62b4e-db53-4520-a9f3-87a42c19590d" (UID: "8fe62b4e-db53-4520-a9f3-87a42c19590d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:23:00.070177 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.070105    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fe62b4e-db53-4520-a9f3-87a42c19590d-cabundle-cert" pod "8fe62b4e-db53-4520-a9f3-87a42c19590d" (UID: "8fe62b4e-db53-4520-a9f3-87a42c19590d"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:23:00.071896 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.071872    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fe62b4e-db53-4520-a9f3-87a42c19590d-kube-api-access-9wxtv" pod "8fe62b4e-db53-4520-a9f3-87a42c19590d" (UID: "8fe62b4e-db53-4520-a9f3-87a42c19590d"). InnerVolumeSpecName "kube-api-access-9wxtv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:23:00.071896 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.071881    5068 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fe62b4e-db53-4520-a9f3-87a42c19590d-proxy-tls" pod "8fe62b4e-db53-4520-a9f3-87a42c19590d" (UID: "8fe62b4e-db53-4520-a9f3-87a42c19590d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:23:00.170960 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.170933    5068 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8fe62b4e-db53-4520-a9f3-87a42c19590d-proxy-tls\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:23:00.170960 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.170958    5068 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8fe62b4e-db53-4520-a9f3-87a42c19590d-cabundle-cert\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:23:00.171110 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.170968    5068 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wxtv\" (UniqueName: \"kubernetes.io/projected/8fe62b4e-db53-4520-a9f3-87a42c19590d-kube-api-access-9wxtv\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:23:00.171110 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.170977    5068 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8fe62b4e-db53-4520-a9f3-87a42c19590d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:23:00.171110 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.170986    5068 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8fe62b4e-db53-4520-a9f3-87a42c19590d-kserve-provision-location\") on node \"ip-10-0-139-40.ec2.internal\" DevicePath \"\""
Oct 30 03:23:00.730510 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.730476    5068 generic.go:356] "Generic (PLEG): container finished" podID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerID="a5fdeba7384f4640469ecae3bd739af506115dc125ee0aef598c12b51e79fa4e" exitCode=0
Oct 30 03:23:00.730925 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.730536    5068 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"
Oct 30 03:23:00.730925 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.730545    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" event={"ID":"8fe62b4e-db53-4520-a9f3-87a42c19590d","Type":"ContainerDied","Data":"a5fdeba7384f4640469ecae3bd739af506115dc125ee0aef598c12b51e79fa4e"}
Oct 30 03:23:00.730925 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.730593    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg" event={"ID":"8fe62b4e-db53-4520-a9f3-87a42c19590d","Type":"ContainerDied","Data":"c13951e9fa01147df4c0e2d71e9748df413ae7779dea378dd9e6e5b2a463134c"}
Oct 30 03:23:00.730925 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.730618    5068 scope.go:122] "RemoveContainer" containerID="2c37cd89e45ae642d6f7c1f5fa0702a5c8134f3e763ed18a1f570b2d134f4eb9"
Oct 30 03:23:00.739012 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.738995    5068 scope.go:122] "RemoveContainer" containerID="a5fdeba7384f4640469ecae3bd739af506115dc125ee0aef598c12b51e79fa4e"
Oct 30 03:23:00.745984 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.745967    5068 scope.go:122] "RemoveContainer" containerID="24e3d96dd42bedf850b0ebf7364d63ecbf44d376b74d2127780cdb2e1e902466"
Oct 30 03:23:00.752764 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.752745    5068 scope.go:122] "RemoveContainer" containerID="2c37cd89e45ae642d6f7c1f5fa0702a5c8134f3e763ed18a1f570b2d134f4eb9"
Oct 30 03:23:00.753060 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:23:00.753039    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c37cd89e45ae642d6f7c1f5fa0702a5c8134f3e763ed18a1f570b2d134f4eb9\": container with ID starting with 2c37cd89e45ae642d6f7c1f5fa0702a5c8134f3e763ed18a1f570b2d134f4eb9 not found: ID does not exist" containerID="2c37cd89e45ae642d6f7c1f5fa0702a5c8134f3e763ed18a1f570b2d134f4eb9"
Oct 30 03:23:00.753110 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.753069    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c37cd89e45ae642d6f7c1f5fa0702a5c8134f3e763ed18a1f570b2d134f4eb9"} err="failed to get container status \"2c37cd89e45ae642d6f7c1f5fa0702a5c8134f3e763ed18a1f570b2d134f4eb9\": rpc error: code = NotFound desc = could not find container \"2c37cd89e45ae642d6f7c1f5fa0702a5c8134f3e763ed18a1f570b2d134f4eb9\": container with ID starting with 2c37cd89e45ae642d6f7c1f5fa0702a5c8134f3e763ed18a1f570b2d134f4eb9 not found: ID does not exist"
Oct 30 03:23:00.753110 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.753088    5068 scope.go:122] "RemoveContainer" containerID="a5fdeba7384f4640469ecae3bd739af506115dc125ee0aef598c12b51e79fa4e"
Oct 30 03:23:00.753320 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:23:00.753301    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5fdeba7384f4640469ecae3bd739af506115dc125ee0aef598c12b51e79fa4e\": container with ID starting with a5fdeba7384f4640469ecae3bd739af506115dc125ee0aef598c12b51e79fa4e not found: ID does not exist" containerID="a5fdeba7384f4640469ecae3bd739af506115dc125ee0aef598c12b51e79fa4e"
Oct 30 03:23:00.753361 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.753328    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5fdeba7384f4640469ecae3bd739af506115dc125ee0aef598c12b51e79fa4e"} err="failed to get container status \"a5fdeba7384f4640469ecae3bd739af506115dc125ee0aef598c12b51e79fa4e\": rpc error: code = NotFound desc = could not find container \"a5fdeba7384f4640469ecae3bd739af506115dc125ee0aef598c12b51e79fa4e\": container with ID starting with a5fdeba7384f4640469ecae3bd739af506115dc125ee0aef598c12b51e79fa4e not found: ID does not exist"
Oct 30 03:23:00.753361 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.753344    5068 scope.go:122] "RemoveContainer" containerID="24e3d96dd42bedf850b0ebf7364d63ecbf44d376b74d2127780cdb2e1e902466"
Oct 30 03:23:00.753560 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:23:00.753544    5068 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24e3d96dd42bedf850b0ebf7364d63ecbf44d376b74d2127780cdb2e1e902466\": container with ID starting with 24e3d96dd42bedf850b0ebf7364d63ecbf44d376b74d2127780cdb2e1e902466 not found: ID does not exist" containerID="24e3d96dd42bedf850b0ebf7364d63ecbf44d376b74d2127780cdb2e1e902466"
Oct 30 03:23:00.753599 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.753569    5068 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24e3d96dd42bedf850b0ebf7364d63ecbf44d376b74d2127780cdb2e1e902466"} err="failed to get container status \"24e3d96dd42bedf850b0ebf7364d63ecbf44d376b74d2127780cdb2e1e902466\": rpc error: code = NotFound desc = could not find container \"24e3d96dd42bedf850b0ebf7364d63ecbf44d376b74d2127780cdb2e1e902466\": container with ID starting with 24e3d96dd42bedf850b0ebf7364d63ecbf44d376b74d2127780cdb2e1e902466 not found: ID does not exist"
Oct 30 03:23:00.799341 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.799319    5068 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"]
Oct 30 03:23:00.820991 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:00.820966    5068 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-d44ea3c803/isvc-canary-promote-v2-predictor-788cb55695-kg7zg"]
Oct 30 03:23:01.071260 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:01.071181    5068 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" path="/var/lib/kubelet/pods/8fe62b4e-db53-4520-a9f3-87a42c19590d/volumes"
Oct 30 03:23:02.919618 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:02.919570    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:23:07.280837 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:23:07.280788    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:23:10.540813 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:10.540771    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:23:10.725637 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:10.725599    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:23:12.720477 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:12.720447    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:23:12.892025 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:12.891984    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:23:14.166727 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:14.166666    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:23:14.371637 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:14.371598    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:23:24.205775 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:24.205737    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:23:24.374045 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:24.374009    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:23:35.891462 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:23:35.891424    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:23:37.281183 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:23:37.281143    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:24:07.282167 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:24:07.282131    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:24:36.024077 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:24:36.024031    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:24:37.281719 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:24:37.281669    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:24:50.504904 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:24:50.504857    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:25:00.485244 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:25:00.485205    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:25:00.659338 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:25:00.659305    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:25:07.280946 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:25:07.280912    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:25:31.760604 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:25:31.760565    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:25:33.298188 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:25:33.298150    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:25:33.466610 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:25:33.466568    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:25:36.143063 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:25:36.143031    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:25:37.280759 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:25:37.280722    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:25:38.101441 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:25:38.101409    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:25:38.264289 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:25:38.264262    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:25:43.221932 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:25:43.221902    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/1.log"
Oct 30 03:25:43.225985 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:25:43.225961    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/1.log"
Oct 30 03:26:07.281898 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:26:07.281858    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:26:36.302156 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:26:36.302072    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:26:37.280637 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:26:37.280604    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:27:07.281355 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:27:07.281318    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:27:36.410828 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:36.410784    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:27:37.281212 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:27:37.281178    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:27:40.012564 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.012523    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:27:40.225107 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.225077    5068 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8jkc8/must-gather-rsnk8"]
Oct 30 03:27:40.225366 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.225354    5068 cpu_manager.go:414] "containerMap: removing container" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kube-rbac-proxy"
Oct 30 03:27:40.225411 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.225366    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kube-rbac-proxy"
Oct 30 03:27:40.225411 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.225381    5068 cpu_manager.go:414] "containerMap: removing container" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kserve-container"
Oct 30 03:27:40.225411 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.225387    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kserve-container"
Oct 30 03:27:40.225411 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.225399    5068 cpu_manager.go:414] "containerMap: removing container" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="storage-initializer"
Oct 30 03:27:40.225411 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.225404    5068 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="storage-initializer"
Oct 30 03:27:40.225587 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.225459    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kube-rbac-proxy"
Oct 30 03:27:40.225587 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.225467    5068 memory_manager.go:365] "RemoveStaleState removing state" podUID="8fe62b4e-db53-4520-a9f3-87a42c19590d" containerName="kserve-container"
Oct 30 03:27:40.228482 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.228460    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8jkc8/must-gather-rsnk8"
Oct 30 03:27:40.241534 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.241514    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8jkc8\"/\"openshift-service-ca.crt\""
Oct 30 03:27:40.251027 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.251006    5068 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8jkc8\"/\"kube-root-ca.crt\""
Oct 30 03:27:40.251121 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.251106    5068 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8jkc8\"/\"default-dockercfg-ph9l8\""
Oct 30 03:27:40.252110 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.252070    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8jkc8/must-gather-rsnk8"]
Oct 30 03:27:40.277149 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.277095    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:27:40.355477 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.355452    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrxnn\" (UniqueName: \"kubernetes.io/projected/8cba317b-161a-4bba-afb0-c2e7b8860772-kube-api-access-mrxnn\") pod \"must-gather-rsnk8\" (UID: \"8cba317b-161a-4bba-afb0-c2e7b8860772\") " pod="openshift-must-gather-8jkc8/must-gather-rsnk8"
Oct 30 03:27:40.355582 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.355514    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8cba317b-161a-4bba-afb0-c2e7b8860772-must-gather-output\") pod \"must-gather-rsnk8\" (UID: \"8cba317b-161a-4bba-afb0-c2e7b8860772\") " pod="openshift-must-gather-8jkc8/must-gather-rsnk8"
Oct 30 03:27:40.450318 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.450285    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:27:40.456389 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.456367    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8cba317b-161a-4bba-afb0-c2e7b8860772-must-gather-output\") pod \"must-gather-rsnk8\" (UID: \"8cba317b-161a-4bba-afb0-c2e7b8860772\") " pod="openshift-must-gather-8jkc8/must-gather-rsnk8"
Oct 30 03:27:40.456492 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.456402    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrxnn\" (UniqueName: \"kubernetes.io/projected/8cba317b-161a-4bba-afb0-c2e7b8860772-kube-api-access-mrxnn\") pod \"must-gather-rsnk8\" (UID: \"8cba317b-161a-4bba-afb0-c2e7b8860772\") " pod="openshift-must-gather-8jkc8/must-gather-rsnk8"
Oct 30 03:27:40.456721 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.456705    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8cba317b-161a-4bba-afb0-c2e7b8860772-must-gather-output\") pod \"must-gather-rsnk8\" (UID: \"8cba317b-161a-4bba-afb0-c2e7b8860772\") " pod="openshift-must-gather-8jkc8/must-gather-rsnk8"
Oct 30 03:27:40.478520 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.478489    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrxnn\" (UniqueName: \"kubernetes.io/projected/8cba317b-161a-4bba-afb0-c2e7b8860772-kube-api-access-mrxnn\") pod \"must-gather-rsnk8\" (UID: \"8cba317b-161a-4bba-afb0-c2e7b8860772\") " pod="openshift-must-gather-8jkc8/must-gather-rsnk8"
Oct 30 03:27:40.552333 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.552266    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8jkc8/must-gather-rsnk8"
Oct 30 03:27:40.846903 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.846830    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8jkc8/must-gather-rsnk8"]
Oct 30 03:27:40.852447 ip-10-0-139-40 kubenswrapper[5068]: W1030 03:27:40.852419    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8cba317b_161a_4bba_afb0_c2e7b8860772.slice/crio-6b8a9c3a9ceb45d057e970dc61dacbbab1ef7c1bac58895f053c438207b7d4a7 WatchSource:0}: Error finding container 6b8a9c3a9ceb45d057e970dc61dacbbab1ef7c1bac58895f053c438207b7d4a7: Status 404 returned error can't find the container with id 6b8a9c3a9ceb45d057e970dc61dacbbab1ef7c1bac58895f053c438207b7d4a7
Oct 30 03:27:40.854662 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:40.854643    5068 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 03:27:41.794893 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:41.794819    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8jkc8/must-gather-rsnk8" event={"ID":"8cba317b-161a-4bba-afb0-c2e7b8860772","Type":"ContainerStarted","Data":"b012a10f739b63a0347fd609ca8ef79547364ee9d23c508c9909a92d2e63a3ed"}
Oct 30 03:27:41.794893 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:41.794860    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8jkc8/must-gather-rsnk8" event={"ID":"8cba317b-161a-4bba-afb0-c2e7b8860772","Type":"ContainerStarted","Data":"6b8a9c3a9ceb45d057e970dc61dacbbab1ef7c1bac58895f053c438207b7d4a7"}
Oct 30 03:27:42.800918 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:42.800881    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8jkc8/must-gather-rsnk8" event={"ID":"8cba317b-161a-4bba-afb0-c2e7b8860772","Type":"ContainerStarted","Data":"3518048818f32460581bf9956a504ba1884529d01bbce4ef5eda67bcf60c6473"}
Oct 30 03:27:42.838531 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:42.838471    5068 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-8jkc8/must-gather-rsnk8" podStartSLOduration=2.04341306 podStartE2EDuration="2.838454461s" totalImagesPullingTime="795.041401ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:27:42.838331586 +0000 UTC m=+1919.913701798" watchObservedRunningTime="2026-10-30 03:27:42.838454461 +0000 UTC m=+1919.913824673"
Oct 30 03:27:44.860882 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:44.860848    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lg4vm_f785b5c4-7dd0-4f7b-9980-e1146f9bbdfc/global-pull-secret-syncer/0.log"
Oct 30 03:27:45.295345 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:45.295315    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-dtw44_f71c9dd2-5916-4cd5-9aea-6fd70a343419/connection-checker/0.log"
Oct 30 03:27:45.422427 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:45.422397    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-fvrpn_008e880d-1e3d-4290-b25f-442ee1d90975/connection-checker/0.log"
Oct 30 03:27:45.549562 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:45.549492    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-sppcg_51b2e157-f1a2-4630-aab9-9ddcd71d5bca/connection-checker/0.log"
Oct 30 03:27:45.690461 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:45.690431    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log"
Oct 30 03:27:45.850095 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:45.850019    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:27:46.017330 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:46.017300    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:27:46.087795 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:46.082680    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-40.ec2.internal_13718fab620286fdb285c77e4037fd98/haproxy/0.log"
Oct 30 03:27:51.767186 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:51.767151    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-9d2rd_05bcf726-e398-4201-b974-52406fbdc287/cluster-monitoring-operator/0.log"
Oct 30 03:27:52.536248 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:52.536213    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9qbw2_828fa7d3-05b9-4bc9-a0cf-587cde0d64ec/node-exporter/0.log"
Oct 30 03:27:52.664337 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:52.664313    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9qbw2_828fa7d3-05b9-4bc9-a0cf-587cde0d64ec/kube-rbac-proxy/0.log"
Oct 30 03:27:52.788387 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:52.788309    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9qbw2_828fa7d3-05b9-4bc9-a0cf-587cde0d64ec/init-textfile/0.log"
Oct 30 03:27:53.485438 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:53.485403    5068 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"]
Oct 30 03:27:53.494002 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:53.493976    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"
Oct 30 03:27:53.510802 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:53.510771    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"]
Oct 30 03:27:53.636977 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:53.636947    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmrhk\" (UniqueName: \"kubernetes.io/projected/a48072cc-653a-4814-b141-34001f2a9d81-kube-api-access-zmrhk\") pod \"perf-node-gather-daemonset-465vz\" (UID: \"a48072cc-653a-4814-b141-34001f2a9d81\") " pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"
Oct 30 03:27:53.636977 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:53.636984    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a48072cc-653a-4814-b141-34001f2a9d81-proc\") pod \"perf-node-gather-daemonset-465vz\" (UID: \"a48072cc-653a-4814-b141-34001f2a9d81\") " pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"
Oct 30 03:27:53.637223 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:53.637002    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a48072cc-653a-4814-b141-34001f2a9d81-podres\") pod \"perf-node-gather-daemonset-465vz\" (UID: \"a48072cc-653a-4814-b141-34001f2a9d81\") " pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"
Oct 30 03:27:53.637223 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:53.637102    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a48072cc-653a-4814-b141-34001f2a9d81-lib-modules\") pod \"perf-node-gather-daemonset-465vz\" (UID: \"a48072cc-653a-4814-b141-34001f2a9d81\") " pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"
Oct 30 03:27:53.637223 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:53.637178    5068 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a48072cc-653a-4814-b141-34001f2a9d81-sys\") pod \"perf-node-gather-daemonset-465vz\" (UID: \"a48072cc-653a-4814-b141-34001f2a9d81\") " pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"
Oct 30 03:27:53.738259 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:53.738186    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a48072cc-653a-4814-b141-34001f2a9d81-sys\") pod \"perf-node-gather-daemonset-465vz\" (UID: \"a48072cc-653a-4814-b141-34001f2a9d81\") " pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"
Oct 30 03:27:53.738259 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:53.738237    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmrhk\" (UniqueName: \"kubernetes.io/projected/a48072cc-653a-4814-b141-34001f2a9d81-kube-api-access-zmrhk\") pod \"perf-node-gather-daemonset-465vz\" (UID: \"a48072cc-653a-4814-b141-34001f2a9d81\") " pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"
Oct 30 03:27:53.738474 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:53.738273    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a48072cc-653a-4814-b141-34001f2a9d81-proc\") pod \"perf-node-gather-daemonset-465vz\" (UID: \"a48072cc-653a-4814-b141-34001f2a9d81\") " pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"
Oct 30 03:27:53.738474 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:53.738292    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a48072cc-653a-4814-b141-34001f2a9d81-podres\") pod \"perf-node-gather-daemonset-465vz\" (UID: \"a48072cc-653a-4814-b141-34001f2a9d81\") " pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"
Oct 30 03:27:53.738474 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:53.738320    5068 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a48072cc-653a-4814-b141-34001f2a9d81-lib-modules\") pod \"perf-node-gather-daemonset-465vz\" (UID: \"a48072cc-653a-4814-b141-34001f2a9d81\") " pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"
Oct 30 03:27:53.738474 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:53.738337    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a48072cc-653a-4814-b141-34001f2a9d81-sys\") pod \"perf-node-gather-daemonset-465vz\" (UID: \"a48072cc-653a-4814-b141-34001f2a9d81\") " pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"
Oct 30 03:27:53.738474 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:53.738384    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a48072cc-653a-4814-b141-34001f2a9d81-proc\") pod \"perf-node-gather-daemonset-465vz\" (UID: \"a48072cc-653a-4814-b141-34001f2a9d81\") " pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"
Oct 30 03:27:53.738474 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:53.738420    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a48072cc-653a-4814-b141-34001f2a9d81-lib-modules\") pod \"perf-node-gather-daemonset-465vz\" (UID: \"a48072cc-653a-4814-b141-34001f2a9d81\") " pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"
Oct 30 03:27:53.738474 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:53.738424    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a48072cc-653a-4814-b141-34001f2a9d81-podres\") pod \"perf-node-gather-daemonset-465vz\" (UID: \"a48072cc-653a-4814-b141-34001f2a9d81\") " pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"
Oct 30 03:27:53.761089 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:53.761054    5068 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmrhk\" (UniqueName: \"kubernetes.io/projected/a48072cc-653a-4814-b141-34001f2a9d81-kube-api-access-zmrhk\") pod \"perf-node-gather-daemonset-465vz\" (UID: \"a48072cc-653a-4814-b141-34001f2a9d81\") " pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"
Oct 30 03:27:53.811516 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:53.811486    5068 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"
Oct 30 03:27:54.113842 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:54.113764    5068 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"]
Oct 30 03:27:54.120851 ip-10-0-139-40 kubenswrapper[5068]: W1030 03:27:54.120807    5068 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda48072cc_653a_4814_b141_34001f2a9d81.slice/crio-262249de8bb32b3cafc85ab6b0cfaaf37f5c30833d793461a016a3b01561efcd WatchSource:0}: Error finding container 262249de8bb32b3cafc85ab6b0cfaaf37f5c30833d793461a016a3b01561efcd: Status 404 returned error can't find the container with id 262249de8bb32b3cafc85ab6b0cfaaf37f5c30833d793461a016a3b01561efcd
Oct 30 03:27:54.871118 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:54.871026    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz" event={"ID":"a48072cc-653a-4814-b141-34001f2a9d81","Type":"ContainerStarted","Data":"4e622372051bd5d5e38553bab0f0a9fe9815a9125994251afe88cc200211d890"}
Oct 30 03:27:54.871527 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:54.871115    5068 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz" event={"ID":"a48072cc-653a-4814-b141-34001f2a9d81","Type":"ContainerStarted","Data":"262249de8bb32b3cafc85ab6b0cfaaf37f5c30833d793461a016a3b01561efcd"}
Oct 30 03:27:54.871527 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:54.871172    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"
Oct 30 03:27:54.909494 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:54.909446    5068 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz" podStartSLOduration=1.9094340079999998 podStartE2EDuration="1.909434008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 03:27:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:27:54.908717508 +0000 UTC m=+1931.984087719" watchObservedRunningTime="2026-10-30 03:27:54.909434008 +0000 UTC m=+1931.984804219"
Oct 30 03:27:56.881079 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:56.881040    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:27:57.879410 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:57.879382    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-jkkwx_744bf9e1-3e8b-402c-863a-331a6786f85c/networking-console-plugin/0.log"
Oct 30 03:27:58.779462 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:58.779425    5068 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jm4j_3bbb4629-dd25-4dae-b2a0-be0099cacaeb/konnectivity-agent/0.log" limit=1024
Oct 30 03:27:58.913810 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:58.913757    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/1.log"
Oct 30 03:27:58.917678 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:27:58.917658    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-glqfz_23e7ce26-ee23-41a7-a925-6fa7c29eda06/console-operator/2.log"
Oct 30 03:28:00.885263 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:28:00.885232    5068 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8jkc8/perf-node-gather-daemonset-465vz"
Oct 30 03:28:01.058403 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:28:01.058367    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-cxwq4_6aa78c16-a2a2-4a61-adb7-575224b8ac6f/volume-data-source-validator/0.log"
Oct 30 03:28:03.253908 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:28:03.253876    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ftq8q_45836983-c4ed-4083-886b-07e4c4264527/dns/0.log"
Oct 30 03:28:03.377431 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:28:03.377392    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ftq8q_45836983-c4ed-4083-886b-07e4c4264527/kube-rbac-proxy/0.log"
Oct 30 03:28:04.331009 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:28:04.330986    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ttjnv_322fa146-852c-4aca-a334-e9ba4e23d8ad/dns-node-resolver/0.log"
Oct 30 03:28:05.848649 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:28:05.848617    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s8pxs_dec5346e-cd73-40b5-bcf4-05bc1a7e33e2/node-ca/0.log"
Oct 30 03:28:07.284282 ip-10-0-139-40 kubenswrapper[5068]: E1030 03:28:07.284243    5068 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9jzff" containerName="extractor"
Oct 30 03:28:07.667014 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:28:07.666981    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67f9ffd857-gnqzw_deae1b40-455b-40fd-af9a-c9dfa727a018/router/0.log"
Oct 30 03:28:08.876041 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:28:08.876012    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xqnbh_26009c26-16bc-4e82-8246-ebf75fa644e9/serve-healthcheck-canary/0.log"
Oct 30 03:28:09.819629 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:28:09.819599    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-kss29_0155b708-711a-4794-9fd5-bd88e9cae690/insights-operator/0.log"
Oct 30 03:28:09.820024 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:28:09.820009    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-kss29_0155b708-711a-4794-9fd5-bd88e9cae690/insights-operator/1.log"
Oct 30 03:28:09.926277 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:28:09.926247    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9jzff_b1eeaa36-b8dc-4f8a-81f4-54b22848135d/kube-rbac-proxy/0.log"
Oct 30 03:28:10.054604 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:28:10.054574    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9jzff_b1eeaa36-b8dc-4f8a-81f4-54b22848135d/exporter/0.log"
Oct 30 03:28:10.178119 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:28:10.178086    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9jzff_b1eeaa36-b8dc-4f8a-81f4-54b22848135d/extractor/0.log"
Oct 30 03:28:11.070269 ip-10-0-139-40 kubenswrapper[5068]: I1030 03:28:11.070240    5068 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_periodic-gathering-xvhvb-6sczn_07958720-e19a-4054-90ae-0c0cd052f807/insights-gathering/0.log"