Jul 29 10:29:07.933082 ip-10-0-138-159 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 10:29:10.300145 ip-10-0-138-159 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 10:29:10.300145 ip-10-0-138-159 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 10:29:10.300145 ip-10-0-138-159 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 10:29:10.300145 ip-10-0-138-159 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 10:29:10.300145 ip-10-0-138-159 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 10:29:10.300830 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.300212    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 10:29:10.306362 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306345    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 10:29:10.306362 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306362    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 10:29:10.306425 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306365    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 10:29:10.306425 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306368    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 10:29:10.306425 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306372    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 10:29:10.306425 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306376    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 10:29:10.306425 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306379    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 10:29:10.306425 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306382    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 10:29:10.306425 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306385    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 10:29:10.306425 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306388    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 10:29:10.306425 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306391    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 10:29:10.306425 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306393    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 10:29:10.306425 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306396    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 10:29:10.306425 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306398    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 10:29:10.306425 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306401    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 10:29:10.306425 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306403    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 10:29:10.306425 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306406    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 10:29:10.306425 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306409    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 10:29:10.306425 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306411    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 10:29:10.306425 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306414    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 10:29:10.306425 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306417    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 10:29:10.306897 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306427    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 10:29:10.306897 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306431    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 10:29:10.306897 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306436    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 10:29:10.306897 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306440    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 10:29:10.306897 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306443    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 10:29:10.306897 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306446    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 10:29:10.306897 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306449    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 10:29:10.306897 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306451    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 10:29:10.306897 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306454    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 10:29:10.306897 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306456    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 10:29:10.306897 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306459    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 10:29:10.306897 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306462    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 10:29:10.306897 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306464    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 10:29:10.306897 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306467    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 10:29:10.306897 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306469    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 10:29:10.306897 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306472    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 10:29:10.306897 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306474    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 10:29:10.306897 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306477    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 10:29:10.306897 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306480    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 10:29:10.307390 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306482    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 10:29:10.307390 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306486    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 10:29:10.307390 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306491    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 10:29:10.307390 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306494    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 10:29:10.307390 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306496    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 10:29:10.307390 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306499    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 10:29:10.307390 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306501    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 10:29:10.307390 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306503    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 10:29:10.307390 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306506    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 10:29:10.307390 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306508    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 10:29:10.307390 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306511    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 10:29:10.307390 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306514    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 10:29:10.307390 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306516    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 10:29:10.307390 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306518    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 10:29:10.307390 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306526    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 10:29:10.307390 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306529    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 10:29:10.307390 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306531    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 10:29:10.307390 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306534    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 10:29:10.307390 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306536    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 10:29:10.307390 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306539    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 10:29:10.307902 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306542    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 10:29:10.307902 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306545    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 10:29:10.307902 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306548    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 10:29:10.307902 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306551    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 10:29:10.307902 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306553    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 10:29:10.307902 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306556    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 10:29:10.307902 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306558    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 10:29:10.307902 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306561    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 10:29:10.307902 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306563    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 10:29:10.307902 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306566    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 10:29:10.307902 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306568    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 10:29:10.307902 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306571    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 10:29:10.307902 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306574    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 10:29:10.307902 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306576    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 10:29:10.307902 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306580    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 10:29:10.307902 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306583    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 10:29:10.307902 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306586    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 10:29:10.307902 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306591    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 10:29:10.307902 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306594    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 10:29:10.308348 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306597    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 10:29:10.308348 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306599    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 10:29:10.308348 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306602    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 10:29:10.308348 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306604    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 10:29:10.308348 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306607    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 10:29:10.308348 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306609    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 10:29:10.308348 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306612    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 10:29:10.308348 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306615    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 10:29:10.308348 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306618    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 10:29:10.308348 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306621    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 10:29:10.308348 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306624    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 10:29:10.308348 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306627    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 10:29:10.308348 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306629    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 10:29:10.308348 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306631    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 10:29:10.308348 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306634    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 10:29:10.308348 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306636    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 10:29:10.308348 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306639    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 10:29:10.308348 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306641    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 10:29:10.308348 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306644    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 10:29:10.308348 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.306646    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 10:29:10.308848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308288    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 10:29:10.308848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308295    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 10:29:10.308848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308298    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 10:29:10.308848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308301    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 10:29:10.308848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308304    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 10:29:10.308848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308307    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 10:29:10.308848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308310    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 10:29:10.308848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308312    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 10:29:10.308848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308315    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 10:29:10.308848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308317    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 10:29:10.308848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308321    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 10:29:10.308848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308324    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 10:29:10.308848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308326    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 10:29:10.308848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308328    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 10:29:10.308848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308332    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 10:29:10.308848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308337    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 10:29:10.308848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308340    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 10:29:10.308848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308343    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 10:29:10.308848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308347    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 10:29:10.308848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308350    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 10:29:10.309352 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308353    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 10:29:10.309352 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308356    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 10:29:10.309352 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308359    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 10:29:10.309352 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308362    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 10:29:10.309352 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308365    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 10:29:10.309352 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308367    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 10:29:10.309352 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308370    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 10:29:10.309352 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308372    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 10:29:10.309352 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308375    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 10:29:10.309352 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308377    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 10:29:10.309352 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308380    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 10:29:10.309352 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308383    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 10:29:10.309352 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308385    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 10:29:10.309352 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308388    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 10:29:10.309352 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308390    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 10:29:10.309352 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308393    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 10:29:10.309352 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308395    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 10:29:10.309352 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308399    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 10:29:10.309352 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308402    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 10:29:10.309864 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308405    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 10:29:10.309864 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308408    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 10:29:10.309864 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308411    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 10:29:10.309864 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308415    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 10:29:10.309864 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308417    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 10:29:10.309864 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308420    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 10:29:10.309864 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308423    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 10:29:10.309864 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308426    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 10:29:10.309864 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308429    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 10:29:10.309864 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308432    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 10:29:10.309864 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308434    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 10:29:10.309864 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308437    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 10:29:10.309864 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308440    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 10:29:10.309864 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308442    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 10:29:10.309864 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308445    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 10:29:10.309864 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308447    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 10:29:10.309864 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308450    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 10:29:10.309864 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308452    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 10:29:10.309864 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308455    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 10:29:10.309864 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308459    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 10:29:10.310568 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308463    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 10:29:10.310568 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308467    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 10:29:10.310568 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308470    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 10:29:10.310568 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308472    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 10:29:10.310568 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308475    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 10:29:10.310568 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308478    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 10:29:10.310568 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308480    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 10:29:10.310568 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308483    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 10:29:10.310568 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308486    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 10:29:10.310568 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308488    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 10:29:10.310568 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308492    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 10:29:10.310568 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308494    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 10:29:10.310568 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308497    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 10:29:10.310568 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308499    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 10:29:10.310568 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308502    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 10:29:10.310568 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308505    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 10:29:10.310568 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308507    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 10:29:10.310568 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308510    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 10:29:10.310568 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308512    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 10:29:10.310568 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308515    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 10:29:10.311160 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308518    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 10:29:10.311160 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308520    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 10:29:10.311160 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308523    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 10:29:10.311160 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308526    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 10:29:10.311160 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308528    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 10:29:10.311160 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308530    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 10:29:10.311160 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308533    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 10:29:10.311160 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308535    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 10:29:10.311160 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308539    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 10:29:10.311160 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308541    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 10:29:10.311160 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308544    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 10:29:10.311160 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308547    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 10:29:10.311160 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308549    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 10:29:10.311160 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308552    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 10:29:10.311160 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308554    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 10:29:10.311160 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308557    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 10:29:10.311160 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308560    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 10:29:10.311160 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308562    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 10:29:10.311160 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308564    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 10:29:10.311160 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308567    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 10:29:10.311652 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308962    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 10:29:10.311652 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308967    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 10:29:10.311652 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308970    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 10:29:10.311652 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308973    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 10:29:10.311652 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308975    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 10:29:10.311652 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308978    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 10:29:10.311652 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308981    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 10:29:10.311652 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308984    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 10:29:10.311652 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308986    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 10:29:10.311652 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308989    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 10:29:10.311652 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308992    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 10:29:10.311652 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308995    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 10:29:10.311652 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.308997    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 10:29:10.311652 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309000    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 10:29:10.311652 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309002    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 10:29:10.311652 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309005    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 10:29:10.311652 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309007    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 10:29:10.311652 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309010    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 10:29:10.311652 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309013    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 10:29:10.311652 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309015    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 10:29:10.312162 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309019    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 10:29:10.312162 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309023    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 10:29:10.312162 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309025    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 10:29:10.312162 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309028    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 10:29:10.312162 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309030    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 10:29:10.312162 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309033    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 10:29:10.312162 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309035    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 10:29:10.312162 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309038    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 10:29:10.312162 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309040    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 10:29:10.312162 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309042    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 10:29:10.312162 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309045    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 10:29:10.312162 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309047    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 10:29:10.312162 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309050    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 10:29:10.312162 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309052    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 10:29:10.312162 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309055    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 10:29:10.312162 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309057    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 10:29:10.312162 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309060    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 10:29:10.312162 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309062    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 10:29:10.312162 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309065    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 10:29:10.312162 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309067    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 10:29:10.312651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309070    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 10:29:10.312651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309073    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 10:29:10.312651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309076    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 10:29:10.312651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309079    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 10:29:10.312651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309082    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 10:29:10.312651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309084    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 10:29:10.312651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309088    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 10:29:10.312651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309092    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 10:29:10.312651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309095    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 10:29:10.312651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309098    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 10:29:10.312651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309101    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 10:29:10.312651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309103    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 10:29:10.312651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309106    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 10:29:10.312651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309109    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 10:29:10.312651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309112    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 10:29:10.312651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309115    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 10:29:10.312651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309117    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 10:29:10.312651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309121    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 10:29:10.312651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309124    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 10:29:10.313121 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309127    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 10:29:10.313121 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309129    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 10:29:10.313121 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309133    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 10:29:10.313121 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309135    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 10:29:10.313121 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309138    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 10:29:10.313121 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309141    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 10:29:10.313121 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309144    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 10:29:10.313121 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309146    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 10:29:10.313121 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309149    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 10:29:10.313121 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309151    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 10:29:10.313121 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309154    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 10:29:10.313121 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309156    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 10:29:10.313121 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309159    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 10:29:10.313121 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309161    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 10:29:10.313121 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309167    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 10:29:10.313121 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309170    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 10:29:10.313121 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309172    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 10:29:10.313121 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309175    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 10:29:10.313121 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309177    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 10:29:10.313573 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309180    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 10:29:10.313573 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309182    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 10:29:10.313573 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309185    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 10:29:10.313573 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309187    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 10:29:10.313573 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309190    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 10:29:10.313573 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309192    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 10:29:10.313573 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309195    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 10:29:10.313573 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309198    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 10:29:10.313573 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309200    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 10:29:10.313573 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309203    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 10:29:10.313573 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309206    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 10:29:10.313573 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309208    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 10:29:10.313573 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309211    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 10:29:10.313573 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309213    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 10:29:10.313573 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309216    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 10:29:10.313573 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309218    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 10:29:10.313573 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309221    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 10:29:10.313573 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309223    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 10:29:10.313573 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309225    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 10:29:10.313573 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309228    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.309230    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309307    2567 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309317    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309327    2567 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309334    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309339    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309343    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309349    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309354    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309357    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309361    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309364    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309368    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309371    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309374    2567 flags.go:64] FLAG: --cgroup-root=""
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309377    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309380    2567 flags.go:64] FLAG: --client-ca-file=""
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309383    2567 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309386    2567 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309391    2567 flags.go:64] FLAG: --cluster-domain=""
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309394    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309398    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309401    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 10:29:10.314080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309405    2567 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309408    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309412    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309415    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309418    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309421    2567 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309424    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309427    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309430    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309433    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309438    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309441    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309444    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309447    2567 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309450    2567 flags.go:64] FLAG: --enable-server="true"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309453    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309459    2567 flags.go:64] FLAG: --event-burst="100"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309462    2567 flags.go:64] FLAG: --event-qps="50"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309465    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309470    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309473    2567 flags.go:64] FLAG: --eviction-hard=""
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309477    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309480    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309483    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309487    2567 flags.go:64] FLAG: --eviction-soft=""
Jul 29 10:29:10.314658 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309490    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309493    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309496    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309499    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309502    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309505    2567 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309508    2567 flags.go:64] FLAG: --feature-gates=""
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309512    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309516    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309519    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309522    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309525    2567 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309528    2567 flags.go:64] FLAG: --help="false"
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309531    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-138-159.ec2.internal"
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309534    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309537    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309540    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309543    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309547    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309550    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309552    2567 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309555    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309558    2567 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 10:29:10.315305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309562    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309565    2567 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309568    2567 flags.go:64] FLAG: --kube-reserved=""
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309573    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309575    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309578    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309581    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309584    2567 flags.go:64] FLAG: --lock-file=""
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309587    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309590    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309593    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309599    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309602    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309605    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309608    2567 flags.go:64] FLAG: --logging-format="text"
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309610    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309615    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309618    2567 flags.go:64] FLAG: --manifest-url=""
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309621    2567 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309625    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309628    2567 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309632    2567 flags.go:64] FLAG: --max-pods="110"
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309635    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309638    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309641    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 10:29:10.315911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309644    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309648    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309650    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309654    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309661    2567 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309664    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309667    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309671    2567 flags.go:64] FLAG: --pod-cidr=""
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309674    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309680    2567 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309684    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309687    2567 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309690    2567 flags.go:64] FLAG: --port="10250"
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309693    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309696    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-052b218a202b77a4e"
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309699    2567 flags.go:64] FLAG: --qos-reserved=""
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309702    2567 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309705    2567 flags.go:64] FLAG: --register-node="true"
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309708    2567 flags.go:64] FLAG: --register-with-taints=""
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309726    2567 flags.go:64] FLAG: --registry-burst="10"
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309730    2567 flags.go:64] FLAG: --registry-qps="5"
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309732    2567 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309735    2567 flags.go:64] FLAG: --reserved-memory=""
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309740    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309743    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 10:29:10.316517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309747    2567 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309750    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309753    2567 flags.go:64] FLAG: --runonce="false"
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309756    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309759    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309762    2567 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309765    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309768    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309770    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309774    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309777    2567 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309780    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309783    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309786    2567 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309789    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309794    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309797    2567 flags.go:64] FLAG: --system-cgroups=""
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309801    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309807    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309810    2567 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309813    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309817    2567 flags.go:64] FLAG: --tls-min-version=""
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309820    2567 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309823    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309826    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 10:29:10.317148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309829    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309832    2567 flags.go:64] FLAG: --v="2"
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309836    2567 flags.go:64] FLAG: --version="false"
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309840    2567 flags.go:64] FLAG: --vmodule=""
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309844    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.309847    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312927    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312940    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312944    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312947    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312950    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312953    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312956    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312959    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312962    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312964    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312968    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312970    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312973    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312976    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312979    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 10:29:10.317778 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312981    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 10:29:10.318282 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312984    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 10:29:10.318282 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312987    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 10:29:10.318282 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312990    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 10:29:10.318282 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312992    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 10:29:10.318282 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312995    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 10:29:10.318282 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.312998    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 10:29:10.318282 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313000    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 10:29:10.318282 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313003    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 10:29:10.318282 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313005    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 10:29:10.318282 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313009    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 10:29:10.318282 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313013    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 10:29:10.318282 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313016    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 10:29:10.318282 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313018    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 10:29:10.318282 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313021    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 10:29:10.318282 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313024    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 10:29:10.318282 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313027    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 10:29:10.318282 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313031    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 10:29:10.318282 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313034    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 10:29:10.318282 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313037    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 10:29:10.318282 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313039    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 10:29:10.318818 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313042    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 10:29:10.318818 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313045    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 10:29:10.318818 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313048    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 10:29:10.318818 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313051    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 10:29:10.318818 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313054    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 10:29:10.318818 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313056    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 10:29:10.318818 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313059    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 10:29:10.318818 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313062    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 10:29:10.318818 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313064    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 10:29:10.318818 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313067    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 10:29:10.318818 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313069    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 10:29:10.318818 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313072    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 10:29:10.318818 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313075    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 10:29:10.318818 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313077    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 10:29:10.318818 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313081    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 10:29:10.318818 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313083    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 10:29:10.318818 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313087    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 10:29:10.318818 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313092    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 10:29:10.318818 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313095    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 10:29:10.319360 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313098    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 10:29:10.319360 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313102    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 10:29:10.319360 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313104    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 10:29:10.319360 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313107    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 10:29:10.319360 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313110    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 10:29:10.319360 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313113    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 10:29:10.319360 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313116    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 10:29:10.319360 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313118    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 10:29:10.319360 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313121    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 10:29:10.319360 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313124    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 10:29:10.319360 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313127    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 10:29:10.319360 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313129    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 10:29:10.319360 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313132    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 10:29:10.319360 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313135    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 10:29:10.319360 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313138    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 10:29:10.319360 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313140    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 10:29:10.319360 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313143    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 10:29:10.319360 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313146    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 10:29:10.319360 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313148    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 10:29:10.320197 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313151    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 10:29:10.320197 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313153    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 10:29:10.320197 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313156    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 10:29:10.320197 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313159    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 10:29:10.320197 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313161    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 10:29:10.320197 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313164    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 10:29:10.320197 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313166    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 10:29:10.320197 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313169    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 10:29:10.320197 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313171    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 10:29:10.320197 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313174    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 10:29:10.320197 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313177    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 10:29:10.320197 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313180    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 10:29:10.320197 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313182    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 10:29:10.320197 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313184    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 10:29:10.320197 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313187    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 10:29:10.320197 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313190    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 10:29:10.320197 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313192    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 10:29:10.320197 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313195    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 10:29:10.320197 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313197    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 10:29:10.321022 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313200    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 10:29:10.321022 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313203    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 10:29:10.321022 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313205    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 10:29:10.321022 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313208    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 10:29:10.321022 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313211    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 10:29:10.321022 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.313213    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 10:29:10.321022 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.313661    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 10:29:10.321549 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.321525    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 10:29:10.321549 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.321548    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 10:29:10.322232 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.322221    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 10:29:10.322298 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.322236    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 10:29:10.322364 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322352    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 10:29:10.322417 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322364    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 10:29:10.322417 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322371    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 10:29:10.322417 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322375    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 10:29:10.322417 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322380    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 10:29:10.322417 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322384    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 10:29:10.322417 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322388    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 10:29:10.322417 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322393    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 10:29:10.322417 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322397    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 10:29:10.322417 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322402    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 10:29:10.322417 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322406    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 10:29:10.322417 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322411    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 10:29:10.322417 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322415    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 10:29:10.322417 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322420    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 10:29:10.322417 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322424    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 10:29:10.323028 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322428    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 10:29:10.323028 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322433    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 10:29:10.323028 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322437    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 10:29:10.323028 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322442    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 10:29:10.323028 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322446    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 10:29:10.323028 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322451    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 10:29:10.323028 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322455    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 10:29:10.323028 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322459    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 10:29:10.323028 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322463    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 10:29:10.323028 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322467    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 10:29:10.323028 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322472    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 10:29:10.323028 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322475    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 10:29:10.323028 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322480    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 10:29:10.323028 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322484    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 10:29:10.323028 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322488    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 10:29:10.323028 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322493    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 10:29:10.323028 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322497    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 10:29:10.323028 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322501    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 10:29:10.323028 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322505    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 10:29:10.323028 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322509    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 10:29:10.323848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322513    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 10:29:10.323848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322518    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 10:29:10.323848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322522    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 10:29:10.323848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322526    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 10:29:10.323848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322530    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 10:29:10.323848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322535    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 10:29:10.323848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322539    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 10:29:10.323848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322543    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 10:29:10.323848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322548    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 10:29:10.323848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322553    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 10:29:10.323848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322558    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 10:29:10.323848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322562    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 10:29:10.323848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322566    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 10:29:10.323848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322571    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 10:29:10.323848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322576    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 10:29:10.323848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322580    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 10:29:10.323848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322585    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 10:29:10.323848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322589    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 10:29:10.323848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322593    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 10:29:10.323848 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322597    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 10:29:10.324347 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322601    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 10:29:10.324347 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322606    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 10:29:10.324347 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322610    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 10:29:10.324347 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322614    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 10:29:10.324347 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322619    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 10:29:10.324347 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322623    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 10:29:10.324347 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322627    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 10:29:10.324347 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322631    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 10:29:10.324347 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322635    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 10:29:10.324347 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322640    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 10:29:10.324347 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322644    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 10:29:10.324347 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322648    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 10:29:10.324347 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322652    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 10:29:10.324347 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322657    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 10:29:10.324347 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322662    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 10:29:10.324347 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322666    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 10:29:10.324347 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322670    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 10:29:10.324347 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322674    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 10:29:10.324347 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322678    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 10:29:10.324347 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322683    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 10:29:10.325187 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322687    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 10:29:10.325187 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322691    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 10:29:10.325187 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322697    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 10:29:10.325187 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322701    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 10:29:10.325187 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322705    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 10:29:10.325187 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322730    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 10:29:10.325187 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322737    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 10:29:10.325187 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322741    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 10:29:10.325187 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322746    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 10:29:10.325187 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322751    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 10:29:10.325187 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322756    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 10:29:10.325187 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322760    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 10:29:10.325187 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322765    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 10:29:10.325187 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322771    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 10:29:10.325187 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322775    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 10:29:10.325187 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322780    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 10:29:10.325187 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322786    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 10:29:10.325187 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322791    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 10:29:10.325187 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322796    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 10:29:10.326139 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322800    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 10:29:10.326139 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322804    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 10:29:10.326139 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322809    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 10:29:10.326139 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322813    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 10:29:10.326139 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.322819    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 10:29:10.326139 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.322828    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 10:29:10.326139 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323016    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 10:29:10.326139 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323024    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 10:29:10.326139 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323029    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 10:29:10.326139 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323034    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 10:29:10.326139 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323038    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 10:29:10.326139 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323043    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 10:29:10.326139 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323048    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 10:29:10.326139 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323052    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 10:29:10.326139 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323056    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 10:29:10.326558 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323060    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 10:29:10.326558 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323066    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 10:29:10.326558 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323070    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 10:29:10.326558 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323075    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 10:29:10.326558 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323080    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 10:29:10.326558 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323084    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 10:29:10.326558 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323088    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 10:29:10.326558 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323092    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 10:29:10.326558 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323097    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 10:29:10.326558 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323101    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 10:29:10.326558 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323105    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 10:29:10.326558 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323110    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 10:29:10.326558 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323114    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 10:29:10.326558 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323118    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 10:29:10.326558 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323122    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 10:29:10.326558 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323127    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 10:29:10.326558 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323131    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 10:29:10.326558 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323135    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 10:29:10.326558 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323140    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 10:29:10.326558 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323144    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 10:29:10.327152 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323148    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 10:29:10.327152 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323153    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 10:29:10.327152 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323157    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 10:29:10.327152 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323161    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 10:29:10.327152 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323165    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 10:29:10.327152 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323169    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 10:29:10.327152 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323173    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 10:29:10.327152 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323178    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 10:29:10.327152 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323182    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 10:29:10.327152 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323187    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 10:29:10.327152 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323191    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 10:29:10.327152 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323195    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 10:29:10.327152 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323199    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 10:29:10.327152 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323205    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 10:29:10.327152 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323212    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 10:29:10.327152 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323218    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 10:29:10.327152 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323225    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 10:29:10.327152 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323230    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 10:29:10.327152 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323235    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 10:29:10.327649 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323239    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 10:29:10.327649 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323243    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 10:29:10.327649 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323248    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 10:29:10.327649 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323252    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 10:29:10.327649 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323256    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 10:29:10.327649 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323260    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 10:29:10.327649 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323264    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 10:29:10.327649 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323269    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 10:29:10.327649 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323273    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 10:29:10.327649 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323277    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 10:29:10.327649 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323281    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 10:29:10.327649 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323286    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 10:29:10.327649 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323290    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 10:29:10.327649 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323294    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 10:29:10.327649 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323299    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 10:29:10.327649 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323303    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 10:29:10.327649 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323309    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 10:29:10.327649 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323314    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 10:29:10.327649 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323319    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 10:29:10.328131 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323324    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 10:29:10.328131 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323328    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 10:29:10.328131 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323332    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 10:29:10.328131 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323337    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 10:29:10.328131 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323341    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 10:29:10.328131 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323345    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 10:29:10.328131 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323349    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 10:29:10.328131 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323354    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 10:29:10.328131 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323358    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 10:29:10.328131 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323363    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 10:29:10.328131 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323367    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 10:29:10.328131 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323372    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 10:29:10.328131 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323376    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 10:29:10.328131 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323380    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 10:29:10.328131 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323384    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 10:29:10.328131 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323388    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 10:29:10.328131 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323392    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 10:29:10.328131 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323397    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 10:29:10.328131 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323401    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 10:29:10.328131 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323405    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 10:29:10.328651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323409    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 10:29:10.328651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323413    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 10:29:10.328651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323425    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 10:29:10.328651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323430    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 10:29:10.328651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323434    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 10:29:10.328651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323438    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 10:29:10.328651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323442    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 10:29:10.328651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323447    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 10:29:10.328651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323451    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 10:29:10.328651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323455    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 10:29:10.328651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323459    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 10:29:10.328651 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:10.323463    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 10:29:10.328651 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.323471    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 10:29:10.328651 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.323634    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 10:29:10.329031 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.326551    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 10:29:10.329031 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.328579    2567 server.go:1019] "Starting client certificate rotation"
Jul 29 10:29:10.329031 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.328686    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 10:29:10.329031 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.328732    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 10:29:10.330793 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.330777    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 10:29:10.335162 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.335141    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 10:29:10.345260 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.345238    2567 log.go:25] "Validated CRI v1 runtime API"
Jul 29 10:29:10.347621 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.347604    2567 log.go:25] "Validated CRI v1 image API"
Jul 29 10:29:10.348816 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.348796    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 10:29:10.350913 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.350894    2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 99d2d237-a494-450b-8b4a-13d22e9ab3ad:/dev/nvme0n1p3 a4c60e91-c904-4b82-8a18-57d5db6966ad:/dev/nvme0n1p4]
Jul 29 10:29:10.350979 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.350913    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 10:29:10.357033 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.356913    2567 manager.go:216] Machine: {Timestamp:2026-07-29 10:29:10.355808306 +0000 UTC m=+0.301047143 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3125486 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e4274d0f87b12ef238dad90ae66ee SystemUUID:ec2e4274-d0f8-7b12-ef23-8dad90ae66ee BootID:40646e10-5d19-4aa3-86a1-1c5685ddf98e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8c:01:bf:81:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8c:01:bf:81:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:40:95:76:ae:04 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 10:29:10.357033 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.357022    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 10:29:10.357204 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.357141    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 10:29:10.359662 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.359642    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 10:29:10.359662 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.359642    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 10:29:10.359869 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.359671    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-159.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 10:29:10.360323 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.360311    2567 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 10:29:10.360374 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.360327    2567 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 10:29:10.360374 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.360338    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 10:29:10.361006 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.360993    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 10:29:10.362183 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.362170    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 10:29:10.364089 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.364075    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 10:29:10.364228 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.364217    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 10:29:10.364296 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.364255    2567 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 10:29:10.364296 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.364269    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 10:29:10.364296 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.364290    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 10:29:10.364411 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.364305    2567 kubelet.go:398] "Adding apiserver pod source"
Jul 29 10:29:10.364411 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.364322    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 10:29:10.364751 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.364737    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 10:29:10.364828 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.364762    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 10:29:10.366787 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.366767    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 10:29:10.368908 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.368894    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 10:29:10.368967 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.368924    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 10:29:10.370851 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.370838    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 10:29:10.370897 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.370855    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 10:29:10.370897 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.370865    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 10:29:10.370897 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.370875    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 10:29:10.370897 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.370886    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 10:29:10.370897 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.370892    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 10:29:10.371026 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.370901    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 10:29:10.371026 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.370906    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 10:29:10.371026 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.370915    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 10:29:10.371026 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.370921    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 10:29:10.371026 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.370930    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 10:29:10.371026 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.370936    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 10:29:10.371504 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.371495    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 10:29:10.371540 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.371505    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 10:29:10.372957 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:10.372934    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-159.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 10:29:10.372957 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:10.372934    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 10:29:10.374816 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.374797    2567 server.go:1268] "Started kubelet"
Jul 29 10:29:10.375377 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.375323    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 10:29:10.375480 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.375403    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 10:29:10.375480 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.375304    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 10:29:10.375656 ip-10-0-138-159 systemd[1]: Started Kubernetes Kubelet.
Jul 29 10:29:10.377290 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.377272    2567 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 10:29:10.379010 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.378992    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 10:29:10.379448 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:10.379426    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 10:29:10.381080 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.381065    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p9xpp"
Jul 29 10:29:10.381988 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.381969    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-159.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 10:29:10.382870 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:10.382000    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-159.ec2.internal.18c6bbf201269826  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-159.ec2.internal,UID:ip-10-0-138-159.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-159.ec2.internal,},FirstTimestamp:2026-07-29 10:29:10.37476663 +0000 UTC m=+0.320005467,LastTimestamp:2026-07-29 10:29:10.37476663 +0000 UTC m=+0.320005467,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-159.ec2.internal,}"
Jul 29 10:29:10.385849 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.385831    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 10:29:10.385849 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.385838    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 10:29:10.386164 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:10.386086    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
Jul 29 10:29:10.387008 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.386858    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 10:29:10.387100 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.386878    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 10:29:10.387100 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.387052    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 10:29:10.387255 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.387164    2567 factory.go:55] Registering systemd factory
Jul 29 10:29:10.387255 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.387181    2567 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 10:29:10.387255 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.387191    2567 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 10:29:10.387255 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.387182    2567 factory.go:223] Registration of the systemd container factory successfully
Jul 29 10:29:10.387684 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:10.387659    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 10:29:10.387780 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.387687    2567 factory.go:153] Registering CRI-O factory
Jul 29 10:29:10.387780 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.387705    2567 factory.go:223] Registration of the crio container factory successfully
Jul 29 10:29:10.387902 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.387803    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 10:29:10.387902 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.387833    2567 factory.go:103] Registering Raw factory
Jul 29 10:29:10.388280 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.388238    2567 manager.go:1196] Started watching for new ooms in manager
Jul 29 10:29:10.388862 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.388845    2567 manager.go:349] Starting recovery of all containers
Jul 29 10:29:10.399966 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.399948    2567 manager.go:354] Recovery completed
Jul 29 10:29:10.400079 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:10.400055    2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-159.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 10:29:10.403563 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.403543    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p9xpp"
Jul 29 10:29:10.404058 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.404047    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 10:29:10.405840 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.405821    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 10:29:10.405918 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.405857    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 10:29:10.405918 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.405874    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientPID"
Jul 29 10:29:10.406465 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.406453    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 10:29:10.406465 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.406465    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 10:29:10.406555 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.406467    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 10:29:10.406555 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.406479    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 10:29:10.407157 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.407143    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 10:29:10.407230 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.407171    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 10:29:10.407230 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.407186    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientPID"
Jul 29 10:29:10.407949 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.407936    2567 policy_none.go:49] "None policy: Start"
Jul 29 10:29:10.408008 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.407953    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 10:29:10.408008 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.407963    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 10:29:10.408886 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.408870    2567 policy_none.go:47] "Start"
Jul 29 10:29:10.447284 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.447268    2567 manager.go:337] "Starting Device Plugin manager"
Jul 29 10:29:10.447377 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:10.447301    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 10:29:10.447377 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.447311    2567 server.go:87] "Starting device plugin registration server"
Jul 29 10:29:10.447622 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.447602    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 10:29:10.447756 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.447618    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 10:29:10.447756 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.447686    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 10:29:10.447860 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.447783    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 10:29:10.447860 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.447792    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 10:29:10.448380 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:10.448349    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 10:29:10.448489 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:10.448408    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-159.ec2.internal\" not found"
Jul 29 10:29:10.548265 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.548194    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 10:29:10.549335 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.549186    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 10:29:10.549335 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.549217    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 10:29:10.549335 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.549232    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientPID"
Jul 29 10:29:10.549335 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.549258    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-159.ec2.internal"
Jul 29 10:29:10.555000 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.554969    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 10:29:10.556295 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.556272    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 10:29:10.556398 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.556316    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 10:29:10.556398 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.556340    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 10:29:10.556398 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:10.556376    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 10:29:10.556899 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.556881    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-159.ec2.internal"
Jul 29 10:29:10.557007 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:10.556921    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-159.ec2.internal\": node \"ip-10-0-138-159.ec2.internal\" not found"
Jul 29 10:29:10.558816 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.558796    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 10:29:10.614256 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:10.614229    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
Jul 29 10:29:10.657520 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.657480    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal"]
Jul 29 10:29:10.657682 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.657570    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 10:29:10.659114 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.659097    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 10:29:10.659203 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.659126    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 10:29:10.659203 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.659137    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientPID"
Jul 29 10:29:10.660610 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.660597    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 10:29:10.660764 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.660749    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal"
Jul 29 10:29:10.660803 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.660784    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 10:29:10.661381 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.661367    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 10:29:10.661436 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.661392    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 10:29:10.661436 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.661402    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientPID"
Jul 29 10:29:10.662043 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.662022    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 10:29:10.662133 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.662055    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 10:29:10.662133 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.662070    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientPID"
Jul 29 10:29:10.662640 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.662624    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal"
Jul 29 10:29:10.662739 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.662655    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 10:29:10.663333 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.663313    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 10:29:10.663431 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.663339    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 10:29:10.663431 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.663351    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientPID"
Jul 29 10:29:10.689094 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.689071    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aead170e01fe516b4b3c2976153a38af-config\") pod \"kube-apiserver-proxy-ip-10-0-138-159.ec2.internal\" (UID: \"aead170e01fe516b4b3c2976153a38af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal"
Jul 29 10:29:10.689214 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.689099    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/37ed332b69ac514232dfbedf893cd802-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal\" (UID: \"37ed332b69ac514232dfbedf893cd802\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal"
Jul 29 10:29:10.689214 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.689115    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37ed332b69ac514232dfbedf893cd802-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal\" (UID: \"37ed332b69ac514232dfbedf893cd802\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal"
Jul 29 10:29:10.690475 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:10.690456    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-159.ec2.internal\" not found" node="ip-10-0-138-159.ec2.internal"
Jul 29 10:29:10.694798 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:10.694782    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-159.ec2.internal\" not found" node="ip-10-0-138-159.ec2.internal"
Jul 29 10:29:10.714848 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:10.714825    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
Jul 29 10:29:10.789892 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.789858    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/37ed332b69ac514232dfbedf893cd802-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal\" (UID: \"37ed332b69ac514232dfbedf893cd802\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal"
Jul 29 10:29:10.790051 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.789929    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/37ed332b69ac514232dfbedf893cd802-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal\" (UID: \"37ed332b69ac514232dfbedf893cd802\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal"
Jul 29 10:29:10.790051 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.789950    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37ed332b69ac514232dfbedf893cd802-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal\" (UID: \"37ed332b69ac514232dfbedf893cd802\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal"
Jul 29 10:29:10.790051 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.789984    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aead170e01fe516b4b3c2976153a38af-config\") pod \"kube-apiserver-proxy-ip-10-0-138-159.ec2.internal\" (UID: \"aead170e01fe516b4b3c2976153a38af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal"
Jul 29 10:29:10.790051 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.790020    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aead170e01fe516b4b3c2976153a38af-config\") pod \"kube-apiserver-proxy-ip-10-0-138-159.ec2.internal\" (UID: \"aead170e01fe516b4b3c2976153a38af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal"
Jul 29 10:29:10.790051 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.790038    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37ed332b69ac514232dfbedf893cd802-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal\" (UID: \"37ed332b69ac514232dfbedf893cd802\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal"
Jul 29 10:29:10.815011 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:10.814945    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
Jul 29 10:29:10.915771 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:10.915728    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
Jul 29 10:29:10.993307 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.993280    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal"
Jul 29 10:29:10.998574 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:10.998557    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal"
Jul 29 10:29:11.016191 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:11.016159    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
Jul 29 10:29:11.116817 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:11.116706    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
Jul 29 10:29:11.217289 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:11.217237    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
Jul 29 10:29:11.317891 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:11.317840    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
Jul 29 10:29:11.326960 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:11.326937    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 10:29:11.327082 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:11.327066    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 10:29:11.409403 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:11.409320    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 10:24:10 +0000 UTC" deadline="2028-04-07 18:48:57.73123451 +0000 UTC"
Jul 29 10:29:11.409403 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:11.409348    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14840h19m46.32188967s"
Jul 29 10:29:11.418494 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:11.418467    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
Jul 29 10:29:11.443872 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:11.443854    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 10:29:11.518873 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:11.518839    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
Jul 29 10:29:11.533618 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:11.533587    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaead170e01fe516b4b3c2976153a38af.slice/crio-aacb4b9e3a556167bdad9e4a3f4ce62104f2aab1fd2a21339b91c89ce8776306 WatchSource:0}: Error finding container aacb4b9e3a556167bdad9e4a3f4ce62104f2aab1fd2a21339b91c89ce8776306: Status 404 returned error can't find the container with id aacb4b9e3a556167bdad9e4a3f4ce62104f2aab1fd2a21339b91c89ce8776306
Jul 29 10:29:11.537728 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:11.537699    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 10:29:11.559509 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:11.559466    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal" event={"ID":"aead170e01fe516b4b3c2976153a38af","Type":"ContainerStarted","Data":"aacb4b9e3a556167bdad9e4a3f4ce62104f2aab1fd2a21339b91c89ce8776306"}
Jul 29 10:29:11.618941 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:11.618908    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
Jul 29 10:29:11.680931 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:11.680869    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 10:29:11.719923 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:11.719894    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
Jul 29 10:29:11.808595 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:11.808568    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37ed332b69ac514232dfbedf893cd802.slice/crio-3a2c8994a0bb8fc8f2f669cd1f3818ca5e3c8789eb889b1794a355f8bd8b8b52 WatchSource:0}: Error finding container 3a2c8994a0bb8fc8f2f669cd1f3818ca5e3c8789eb889b1794a355f8bd8b8b52: Status 404 returned error can't find the container with id 3a2c8994a0bb8fc8f2f669cd1f3818ca5e3c8789eb889b1794a355f8bd8b8b52
Jul 29 10:29:11.820420 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:11.820399    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
Jul 29 10:29:11.921247 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:11.921216    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
Jul 29 10:29:11.932409 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:11.932362    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 10:29:11.986822 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:11.986801    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal"
Jul 29 10:29:11.999408 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:11.999390    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 10:29:12.000284 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.000270    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal"
Jul 29 10:29:12.013818 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.013799    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 10:29:12.365470 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.365393    2567 apiserver.go:52] "Watching apiserver"
Jul 29 10:29:12.374914 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.374852    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 10:29:12.375809 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.375790    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-csxgd","openshift-network-diagnostics/network-check-target-44zb2","openshift-cluster-node-tuning-operator/tuned-f5jjn","openshift-dns/node-resolver-np8dd","openshift-image-registry/node-ca-2p7vc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal","openshift-network-operator/iptables-alerter-plh6r","openshift-ovn-kubernetes/ovnkube-node-txz46","kube-system/global-pull-secret-syncer-xvrhp","kube-system/konnectivity-agent-vckm7","kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn","openshift-multus/multus-additional-cni-plugins-9n26w","openshift-multus/multus-bhfd5"]
Jul 29 10:29:12.377186 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.377162    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-plh6r"
Jul 29 10:29:12.378384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.378364    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.379542 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.379470    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.379995 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.379947    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 10:29:12.380089 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.379953    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 10:29:12.380367 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.380352    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 10:29:12.380452 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.380375    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kdkqb\""
Jul 29 10:29:12.380782 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.380765    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-np8dd"
Jul 29 10:29:12.381384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.381365    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lvhpx\""
Jul 29 10:29:12.381469 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.381386    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 10:29:12.381967 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.381943    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 10:29:12.382203 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.382179    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 10:29:12.382413 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.382396    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 10:29:12.383522 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.383176    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 10:29:12.383522 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.383298    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 10:29:12.383692 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.383669    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5b9vd\""
Jul 29 10:29:12.383692 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.383682    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 10:29:12.383875 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.383737    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vjll8\""
Jul 29 10:29:12.383875 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.383784    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 10:29:12.384214 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.384197    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2p7vc"
Jul 29 10:29:12.384275 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.384215    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 10:29:12.386371 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.385928    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.386371 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.386085    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 10:29:12.387454 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.387432    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:12.387540 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:12.387514    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:12.387976 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.387957    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 10:29:12.388063 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.387984    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xvffm\""
Jul 29 10:29:12.388063 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.387984    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 10:29:12.388200 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.388094    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 10:29:12.388551 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.388533    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8mxb6\""
Jul 29 10:29:12.388630 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.388553    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 10:29:12.389007 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.388990    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:12.389089 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:12.389061    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:12.390214 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.390193    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:12.390306 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:12.390265    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:12.392491 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.392475    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vckm7"
Jul 29 10:29:12.394275 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.394259    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.395123 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.395108    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 10:29:12.395263 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.395197    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mp7vz\""
Jul 29 10:29:12.395337 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.395271    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 10:29:12.395882 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.395863    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.397069 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.397049    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 10:29:12.397148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.397083    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kmp8j\""
Jul 29 10:29:12.397148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.397049    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 10:29:12.397234 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.397060    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 10:29:12.397516 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.397498    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 10:29:12.397627 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.397607    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 10:29:12.397744 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.397629    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 10:29:12.398086 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.398070    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 10:29:12.398523 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.398503    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-djmrp\""
Jul 29 10:29:12.398617 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.398524    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 10:29:12.398707 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.398688    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 10:29:12.398913 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.398897    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 10:29:12.399209 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399163    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bjw2\" (UniqueName: \"kubernetes.io/projected/c7f5588f-daf4-465c-89f2-5324a87b79db-kube-api-access-5bjw2\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.399209 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399194    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-host-run-k8s-cni-cncf-io\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.399369 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399222    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-hostroot\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.399369 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399250    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/457f5f29-b9d3-4c9e-a703-53e304308abe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.399369 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399272    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-run\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.399369 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399293    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7f5588f-daf4-465c-89f2-5324a87b79db-tmp\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.399369 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399315    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-cni-binary-copy\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.399369 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399338    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-host-var-lib-kubelet\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.399369 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399360    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-host-run-multus-certs\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.399751 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399382    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-etc-kubernetes\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.399751 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399427    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b026f57e-f993-4257-8732-63e69c9aaa3c-dbus\") pod \"global-pull-secret-syncer-xvrhp\" (UID: \"b026f57e-f993-4257-8732-63e69c9aaa3c\") " pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:12.399751 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399449    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-var-lib-kubelet\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.399751 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399464    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-multus-cni-dir\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.399751 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399512    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-multus-socket-dir-parent\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.399751 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399541    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-multus-daemon-config\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.399751 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399570    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cqz8\" (UniqueName: \"kubernetes.io/projected/b2600cf4-d12b-403e-bf31-5ce050c118ef-kube-api-access-7cqz8\") pod \"iptables-alerter-plh6r\" (UID: \"b2600cf4-d12b-403e-bf31-5ce050c118ef\") " pod="openshift-network-operator/iptables-alerter-plh6r"
Jul 29 10:29:12.399751 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399601    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2be1c095-4863-402e-bdf9-d00c0b4fe490-tmp-dir\") pod \"node-resolver-np8dd\" (UID: \"2be1c095-4863-402e-bdf9-d00c0b4fe490\") " pod="openshift-dns/node-resolver-np8dd"
Jul 29 10:29:12.399751 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399652    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2bzb\" (UniqueName: \"kubernetes.io/projected/2be1c095-4863-402e-bdf9-d00c0b4fe490-kube-api-access-w2bzb\") pod \"node-resolver-np8dd\" (UID: \"2be1c095-4863-402e-bdf9-d00c0b4fe490\") " pod="openshift-dns/node-resolver-np8dd"
Jul 29 10:29:12.399751 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399690    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/457f5f29-b9d3-4c9e-a703-53e304308abe-cnibin\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.399751 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399727    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/457f5f29-b9d3-4c9e-a703-53e304308abe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.400188 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399838    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g57z8\" (UniqueName: \"kubernetes.io/projected/a2c35c22-9057-4ecb-8fa3-47630fc253c6-kube-api-access-g57z8\") pod \"node-ca-2p7vc\" (UID: \"a2c35c22-9057-4ecb-8fa3-47630fc253c6\") " pod="openshift-image-registry/node-ca-2p7vc"
Jul 29 10:29:12.400188 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399865    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-os-release\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.400188 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399879    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-host-var-lib-cni-bin\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.400188 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399892    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-host-var-lib-cni-multus\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.400188 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399909    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-lib-modules\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.400188 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399932    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw7lx\" (UniqueName: \"kubernetes.io/projected/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-kube-api-access-gw7lx\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.400188 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399957    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/457f5f29-b9d3-4c9e-a703-53e304308abe-os-release\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.400188 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399975    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/457f5f29-b9d3-4c9e-a703-53e304308abe-cni-binary-copy\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.400188 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.399995    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-sysctl-conf\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.400188 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400010    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-host\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.400188 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400032    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-tuned\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.400188 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400053    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-cnibin\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.400188 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400075    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-host-run-netns\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.400188 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400097    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-multus-conf-dir\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.400188 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400156    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2be1c095-4863-402e-bdf9-d00c0b4fe490-hosts-file\") pod \"node-resolver-np8dd\" (UID: \"2be1c095-4863-402e-bdf9-d00c0b4fe490\") " pod="openshift-dns/node-resolver-np8dd"
Jul 29 10:29:12.400188 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400193    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vnbw\" (UniqueName: \"kubernetes.io/projected/457f5f29-b9d3-4c9e-a703-53e304308abe-kube-api-access-5vnbw\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.400840 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400245    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2c35c22-9057-4ecb-8fa3-47630fc253c6-host\") pod \"node-ca-2p7vc\" (UID: \"a2c35c22-9057-4ecb-8fa3-47630fc253c6\") " pod="openshift-image-registry/node-ca-2p7vc"
Jul 29 10:29:12.400840 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400270    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b2600cf4-d12b-403e-bf31-5ce050c118ef-iptables-alerter-script\") pod \"iptables-alerter-plh6r\" (UID: \"b2600cf4-d12b-403e-bf31-5ce050c118ef\") " pod="openshift-network-operator/iptables-alerter-plh6r"
Jul 29 10:29:12.400840 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400293    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2600cf4-d12b-403e-bf31-5ce050c118ef-host-slash\") pod \"iptables-alerter-plh6r\" (UID: \"b2600cf4-d12b-403e-bf31-5ce050c118ef\") " pod="openshift-network-operator/iptables-alerter-plh6r"
Jul 29 10:29:12.400840 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400324    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b026f57e-f993-4257-8732-63e69c9aaa3c-kubelet-config\") pod \"global-pull-secret-syncer-xvrhp\" (UID: \"b026f57e-f993-4257-8732-63e69c9aaa3c\") " pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:12.400840 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400346    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-sysconfig\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.400840 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400368    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-kubernetes\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.400840 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400389    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-sysctl-d\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.400840 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400409    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-sys\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.400840 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400430    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a2c35c22-9057-4ecb-8fa3-47630fc253c6-serviceca\") pod \"node-ca-2p7vc\" (UID: \"a2c35c22-9057-4ecb-8fa3-47630fc253c6\") " pod="openshift-image-registry/node-ca-2p7vc"
Jul 29 10:29:12.400840 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400464    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-system-cni-dir\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.400840 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400522    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret\") pod \"global-pull-secret-syncer-xvrhp\" (UID: \"b026f57e-f993-4257-8732-63e69c9aaa3c\") " pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:12.400840 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400552    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/457f5f29-b9d3-4c9e-a703-53e304308abe-system-cni-dir\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.400840 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400583    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/457f5f29-b9d3-4c9e-a703-53e304308abe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.400840 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400620    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-modprobe-d\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.400840 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.400641    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-systemd\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.401705 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.401687    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 10:29:12.489091 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.489061    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 10:29:12.501260 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501083    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-cnibin\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.501260 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501127    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-kubelet\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.501260 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501181    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1601bb23-ae66-4343-9f8f-abd8400aae58-socket-dir\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.501260 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501207    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1601bb23-ae66-4343-9f8f-abd8400aae58-etc-selinux\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.501260 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501214    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-cnibin\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.501260 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501233    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2be1c095-4863-402e-bdf9-d00c0b4fe490-hosts-file\") pod \"node-resolver-np8dd\" (UID: \"2be1c095-4863-402e-bdf9-d00c0b4fe490\") " pod="openshift-dns/node-resolver-np8dd"
Jul 29 10:29:12.501674 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501274    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b2600cf4-d12b-403e-bf31-5ce050c118ef-iptables-alerter-script\") pod \"iptables-alerter-plh6r\" (UID: \"b2600cf4-d12b-403e-bf31-5ce050c118ef\") " pod="openshift-network-operator/iptables-alerter-plh6r"
Jul 29 10:29:12.501674 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501325    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2be1c095-4863-402e-bdf9-d00c0b4fe490-hosts-file\") pod \"node-resolver-np8dd\" (UID: \"2be1c095-4863-402e-bdf9-d00c0b4fe490\") " pod="openshift-dns/node-resolver-np8dd"
Jul 29 10:29:12.501674 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501378    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-log-socket\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.501674 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501488    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-kubernetes\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.501674 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501546    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-kubernetes\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.501674 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501576    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-sys\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.501674 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501608    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a2c35c22-9057-4ecb-8fa3-47630fc253c6-serviceca\") pod \"node-ca-2p7vc\" (UID: \"a2c35c22-9057-4ecb-8fa3-47630fc253c6\") " pod="openshift-image-registry/node-ca-2p7vc"
Jul 29 10:29:12.501674 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501634    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-hostroot\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.501674 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501657    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cqz8\" (UniqueName: \"kubernetes.io/projected/b2600cf4-d12b-403e-bf31-5ce050c118ef-kube-api-access-7cqz8\") pod \"iptables-alerter-plh6r\" (UID: \"b2600cf4-d12b-403e-bf31-5ce050c118ef\") " pod="openshift-network-operator/iptables-alerter-plh6r"
Jul 29 10:29:12.502189 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501683    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs\") pod \"network-metrics-daemon-csxgd\" (UID: \"4f79fb8a-c882-40cf-bffd-6685e5b15c8b\") " pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:12.502189 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501707    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-run-openvswitch\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.502189 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501752    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/457f5f29-b9d3-4c9e-a703-53e304308abe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.502189 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501777    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bjw2\" (UniqueName: \"kubernetes.io/projected/c7f5588f-daf4-465c-89f2-5324a87b79db-kube-api-access-5bjw2\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.502189 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501799    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1601bb23-ae66-4343-9f8f-abd8400aae58-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.502189 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501824    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7f5588f-daf4-465c-89f2-5324a87b79db-tmp\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.502189 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501849    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-cni-binary-copy\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.502189 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501873    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1601bb23-ae66-4343-9f8f-abd8400aae58-registration-dir\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.502189 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501924    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1601bb23-ae66-4343-9f8f-abd8400aae58-sys-fs\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.502189 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501945    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-var-lib-kubelet\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.502189 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501965    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwgqm\" (UniqueName: \"kubernetes.io/projected/0c1c684b-d479-45fe-86de-d8e46d15e563-kube-api-access-qwgqm\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.502189 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.501989    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/457f5f29-b9d3-4c9e-a703-53e304308abe-cnibin\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.502189 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502054    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b2600cf4-d12b-403e-bf31-5ce050c118ef-iptables-alerter-script\") pod \"iptables-alerter-plh6r\" (UID: \"b2600cf4-d12b-403e-bf31-5ce050c118ef\") " pod="openshift-network-operator/iptables-alerter-plh6r"
Jul 29 10:29:12.502189 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502154    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g57z8\" (UniqueName: \"kubernetes.io/projected/a2c35c22-9057-4ecb-8fa3-47630fc253c6-kube-api-access-g57z8\") pod \"node-ca-2p7vc\" (UID: \"a2c35c22-9057-4ecb-8fa3-47630fc253c6\") " pod="openshift-image-registry/node-ca-2p7vc"
Jul 29 10:29:12.502189 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502182    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-os-release\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.502878 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502206    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-host-var-lib-cni-multus\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.502878 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502238    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-run-systemd\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.502878 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502263    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1601bb23-ae66-4343-9f8f-abd8400aae58-device-dir\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.502878 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502287    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/457f5f29-b9d3-4c9e-a703-53e304308abe-cni-binary-copy\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.502878 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502310    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-sysctl-conf\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.502878 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502344    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-host\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.502878 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502370    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-host-run-netns\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.502878 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502378    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 10:29:12.502878 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502397    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-multus-conf-dir\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.502878 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502419    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbckv\" (UniqueName: \"kubernetes.io/projected/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-kube-api-access-cbckv\") pod \"network-metrics-daemon-csxgd\" (UID: \"4f79fb8a-c882-40cf-bffd-6685e5b15c8b\") " pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:12.502878 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502439    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9301da60-53ca-42ef-82d0-675b085ca798-konnectivity-ca\") pod \"konnectivity-agent-vckm7\" (UID: \"9301da60-53ca-42ef-82d0-675b085ca798\") " pod="kube-system/konnectivity-agent-vckm7"
Jul 29 10:29:12.502878 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502459    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c1c684b-d479-45fe-86de-d8e46d15e563-env-overrides\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.502878 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502484    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vnbw\" (UniqueName: \"kubernetes.io/projected/457f5f29-b9d3-4c9e-a703-53e304308abe-kube-api-access-5vnbw\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.502878 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502506    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2c35c22-9057-4ecb-8fa3-47630fc253c6-host\") pod \"node-ca-2p7vc\" (UID: \"a2c35c22-9057-4ecb-8fa3-47630fc253c6\") " pod="openshift-image-registry/node-ca-2p7vc"
Jul 29 10:29:12.502878 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502528    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2600cf4-d12b-403e-bf31-5ce050c118ef-host-slash\") pod \"iptables-alerter-plh6r\" (UID: \"b2600cf4-d12b-403e-bf31-5ce050c118ef\") " pod="openshift-network-operator/iptables-alerter-plh6r"
Jul 29 10:29:12.502878 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502554    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbxxv\" (UniqueName: \"kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv\") pod \"network-check-target-44zb2\" (UID: \"5b84c737-c010-44f8-a233-ad9585234e65\") " pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:12.502878 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502581    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-etc-openvswitch\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.503590 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502609    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-run-ovn-kubernetes\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.503590 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502635    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b026f57e-f993-4257-8732-63e69c9aaa3c-kubelet-config\") pod \"global-pull-secret-syncer-xvrhp\" (UID: \"b026f57e-f993-4257-8732-63e69c9aaa3c\") " pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:12.503590 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502660    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-sysconfig\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.503590 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502682    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-sysctl-d\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.503590 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502707    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-system-cni-dir\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.503590 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502747    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-host-run-k8s-cni-cncf-io\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.503590 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502773    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-cni-netd\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.503590 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502799    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c1c684b-d479-45fe-86de-d8e46d15e563-ovnkube-config\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.503590 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502824    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c1c684b-d479-45fe-86de-d8e46d15e563-ovn-node-metrics-cert\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.503590 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502850    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret\") pod \"global-pull-secret-syncer-xvrhp\" (UID: \"b026f57e-f993-4257-8732-63e69c9aaa3c\") " pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:12.503590 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502886    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/457f5f29-b9d3-4c9e-a703-53e304308abe-system-cni-dir\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.503590 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502913    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-modprobe-d\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.503590 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502937    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-systemd\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.503590 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.502978    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-host-run-multus-certs\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.503590 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503004    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-etc-kubernetes\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.503590 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503037    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.503590 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503069    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c1c684b-d479-45fe-86de-d8e46d15e563-ovnkube-script-lib\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.504384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503096    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/457f5f29-b9d3-4c9e-a703-53e304308abe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.504384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503124    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-run\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.504384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503128    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-cni-binary-copy\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.504384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503148    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-host-var-lib-kubelet\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.504384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503174    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9301da60-53ca-42ef-82d0-675b085ca798-agent-certs\") pod \"konnectivity-agent-vckm7\" (UID: \"9301da60-53ca-42ef-82d0-675b085ca798\") " pod="kube-system/konnectivity-agent-vckm7"
Jul 29 10:29:12.504384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503199    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-run-netns\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.504384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503241    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-var-lib-kubelet\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.504384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503238    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b026f57e-f993-4257-8732-63e69c9aaa3c-dbus\") pod \"global-pull-secret-syncer-xvrhp\" (UID: \"b026f57e-f993-4257-8732-63e69c9aaa3c\") " pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:12.504384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503280    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-multus-cni-dir\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.504384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503301    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-multus-socket-dir-parent\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.504384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503324    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-multus-daemon-config\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.504384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503349    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b026f57e-f993-4257-8732-63e69c9aaa3c-dbus\") pod \"global-pull-secret-syncer-xvrhp\" (UID: \"b026f57e-f993-4257-8732-63e69c9aaa3c\") " pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:12.504384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503368    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-systemd-units\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.504384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503437    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-sysconfig\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.504384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503437    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/457f5f29-b9d3-4c9e-a703-53e304308abe-cnibin\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.504384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503518    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-os-release\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.504384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503551    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-host-var-lib-cni-multus\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.504384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503664    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-sysctl-d\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.505187 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503763    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-system-cni-dir\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.505187 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503803    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-host-run-k8s-cni-cncf-io\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.505187 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:12.503924    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 10:29:12.505187 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.503988    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/457f5f29-b9d3-4c9e-a703-53e304308abe-cni-binary-copy\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.505187 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:12.503998    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret podName:b026f57e-f993-4257-8732-63e69c9aaa3c nodeName:}" failed. No retries permitted until 2026-07-29 10:29:13.003978023 +0000 UTC m=+2.949216865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret") pod "global-pull-secret-syncer-xvrhp" (UID: "b026f57e-f993-4257-8732-63e69c9aaa3c") : object "kube-system"/"original-pull-secret" not registered
Jul 29 10:29:12.505187 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.504119    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-sysctl-conf\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.505187 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.504176    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-host\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.505187 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.504208    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/457f5f29-b9d3-4c9e-a703-53e304308abe-system-cni-dir\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.505187 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.504217    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-host-run-netns\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.505187 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.504316    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-systemd\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.505187 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.504383    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-modprobe-d\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.505187 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.504419    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-multus-conf-dir\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.505187 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.504448    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-host-run-multus-certs\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.505187 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.504482    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-etc-kubernetes\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.505187 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.504539    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-sys\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.505187 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.504697    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2c35c22-9057-4ecb-8fa3-47630fc253c6-host\") pod \"node-ca-2p7vc\" (UID: \"a2c35c22-9057-4ecb-8fa3-47630fc253c6\") " pod="openshift-image-registry/node-ca-2p7vc"
Jul 29 10:29:12.505187 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.504946    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a2c35c22-9057-4ecb-8fa3-47630fc253c6-serviceca\") pod \"node-ca-2p7vc\" (UID: \"a2c35c22-9057-4ecb-8fa3-47630fc253c6\") " pod="openshift-image-registry/node-ca-2p7vc"
Jul 29 10:29:12.505187 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.504995    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-hostroot\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.506048 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505111    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/457f5f29-b9d3-4c9e-a703-53e304308abe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.506048 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505155    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2600cf4-d12b-403e-bf31-5ce050c118ef-host-slash\") pod \"iptables-alerter-plh6r\" (UID: \"b2600cf4-d12b-403e-bf31-5ce050c118ef\") " pod="openshift-network-operator/iptables-alerter-plh6r"
Jul 29 10:29:12.506048 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505207    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-multus-cni-dir\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.506048 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505273    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-run\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.506048 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505303    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/457f5f29-b9d3-4c9e-a703-53e304308abe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.506048 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505313    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-multus-socket-dir-parent\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.506048 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505348    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-host-var-lib-kubelet\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.506048 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505352    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b026f57e-f993-4257-8732-63e69c9aaa3c-kubelet-config\") pod \"global-pull-secret-syncer-xvrhp\" (UID: \"b026f57e-f993-4257-8732-63e69c9aaa3c\") " pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:12.506048 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505546    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-slash\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.506048 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505581    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-var-lib-openvswitch\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.506048 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505607    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-node-log\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.506048 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505649    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2be1c095-4863-402e-bdf9-d00c0b4fe490-tmp-dir\") pod \"node-resolver-np8dd\" (UID: \"2be1c095-4863-402e-bdf9-d00c0b4fe490\") " pod="openshift-dns/node-resolver-np8dd"
Jul 29 10:29:12.506048 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505678    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2bzb\" (UniqueName: \"kubernetes.io/projected/2be1c095-4863-402e-bdf9-d00c0b4fe490-kube-api-access-w2bzb\") pod \"node-resolver-np8dd\" (UID: \"2be1c095-4863-402e-bdf9-d00c0b4fe490\") " pod="openshift-dns/node-resolver-np8dd"
Jul 29 10:29:12.506048 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505707    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/457f5f29-b9d3-4c9e-a703-53e304308abe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.506048 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505757    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-host-var-lib-cni-bin\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.506048 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505778    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-multus-daemon-config\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.506048 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505822    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-cni-bin\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.506705 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505850    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw4fc\" (UniqueName: \"kubernetes.io/projected/1601bb23-ae66-4343-9f8f-abd8400aae58-kube-api-access-gw4fc\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.506705 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505877    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-lib-modules\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.506705 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505905    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw7lx\" (UniqueName: \"kubernetes.io/projected/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-kube-api-access-gw7lx\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.506705 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505932    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-run-ovn\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.506705 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.505993    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/457f5f29-b9d3-4c9e-a703-53e304308abe-os-release\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.506705 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.506022    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-tuned\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.506705 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.506032    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2be1c095-4863-402e-bdf9-d00c0b4fe490-tmp-dir\") pod \"node-resolver-np8dd\" (UID: \"2be1c095-4863-402e-bdf9-d00c0b4fe490\") " pod="openshift-dns/node-resolver-np8dd"
Jul 29 10:29:12.506705 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.506614    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/457f5f29-b9d3-4c9e-a703-53e304308abe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.506705 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.506674    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-host-var-lib-cni-bin\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.507078 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.506961    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7f5588f-daf4-465c-89f2-5324a87b79db-lib-modules\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.507206 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.507183    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/457f5f29-b9d3-4c9e-a703-53e304308abe-os-release\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.508412 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.508030    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7f5588f-daf4-465c-89f2-5324a87b79db-tmp\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.510624 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.510601    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c7f5588f-daf4-465c-89f2-5324a87b79db-etc-tuned\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.516851 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.516828    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s748c"
Jul 29 10:29:12.523160 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.523134    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cqz8\" (UniqueName: \"kubernetes.io/projected/b2600cf4-d12b-403e-bf31-5ce050c118ef-kube-api-access-7cqz8\") pod \"iptables-alerter-plh6r\" (UID: \"b2600cf4-d12b-403e-bf31-5ce050c118ef\") " pod="openshift-network-operator/iptables-alerter-plh6r"
Jul 29 10:29:12.523304 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.523282    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s748c"
Jul 29 10:29:12.523445 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.523415    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vnbw\" (UniqueName: \"kubernetes.io/projected/457f5f29-b9d3-4c9e-a703-53e304308abe-kube-api-access-5vnbw\") pod \"multus-additional-cni-plugins-9n26w\" (UID: \"457f5f29-b9d3-4c9e-a703-53e304308abe\") " pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.524960 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.524936    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g57z8\" (UniqueName: \"kubernetes.io/projected/a2c35c22-9057-4ecb-8fa3-47630fc253c6-kube-api-access-g57z8\") pod \"node-ca-2p7vc\" (UID: \"a2c35c22-9057-4ecb-8fa3-47630fc253c6\") " pod="openshift-image-registry/node-ca-2p7vc"
Jul 29 10:29:12.525551 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.525511    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw7lx\" (UniqueName: \"kubernetes.io/projected/cd6d091a-bfcf-4c05-b9ec-9b9fce47117a-kube-api-access-gw7lx\") pod \"multus-bhfd5\" (UID: \"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a\") " pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.527267 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.527246    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bjw2\" (UniqueName: \"kubernetes.io/projected/c7f5588f-daf4-465c-89f2-5324a87b79db-kube-api-access-5bjw2\") pod \"tuned-f5jjn\" (UID: \"c7f5588f-daf4-465c-89f2-5324a87b79db\") " pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.528923 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.528899    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2bzb\" (UniqueName: \"kubernetes.io/projected/2be1c095-4863-402e-bdf9-d00c0b4fe490-kube-api-access-w2bzb\") pod \"node-resolver-np8dd\" (UID: \"2be1c095-4863-402e-bdf9-d00c0b4fe490\") " pod="openshift-dns/node-resolver-np8dd"
Jul 29 10:29:12.563747 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.563655    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal" event={"ID":"37ed332b69ac514232dfbedf893cd802","Type":"ContainerStarted","Data":"3a2c8994a0bb8fc8f2f669cd1f3818ca5e3c8789eb889b1794a355f8bd8b8b52"}
Jul 29 10:29:12.607240 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607209    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-cni-bin\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.607409 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607252    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw4fc\" (UniqueName: \"kubernetes.io/projected/1601bb23-ae66-4343-9f8f-abd8400aae58-kube-api-access-gw4fc\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.607409 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607286    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-cni-bin\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.607409 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607299    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-run-ovn\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.607409 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607329    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-kubelet\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.607409 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607354    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1601bb23-ae66-4343-9f8f-abd8400aae58-socket-dir\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.607409 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607386    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1601bb23-ae66-4343-9f8f-abd8400aae58-etc-selinux\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.607743 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607429    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-log-socket\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.607743 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607457    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs\") pod \"network-metrics-daemon-csxgd\" (UID: \"4f79fb8a-c882-40cf-bffd-6685e5b15c8b\") " pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:12.607743 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607502    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-run-openvswitch\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.607743 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607526    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1601bb23-ae66-4343-9f8f-abd8400aae58-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.607743 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607550    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1601bb23-ae66-4343-9f8f-abd8400aae58-registration-dir\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.607743 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607572    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1601bb23-ae66-4343-9f8f-abd8400aae58-sys-fs\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.607743 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607599    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwgqm\" (UniqueName: \"kubernetes.io/projected/0c1c684b-d479-45fe-86de-d8e46d15e563-kube-api-access-qwgqm\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.607743 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607624    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-run-systemd\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.607743 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607631    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-log-socket\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.607743 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607648    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1601bb23-ae66-4343-9f8f-abd8400aae58-device-dir\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.607743 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607693    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbckv\" (UniqueName: \"kubernetes.io/projected/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-kube-api-access-cbckv\") pod \"network-metrics-daemon-csxgd\" (UID: \"4f79fb8a-c882-40cf-bffd-6685e5b15c8b\") " pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:12.607743 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607728    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1601bb23-ae66-4343-9f8f-abd8400aae58-device-dir\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.607743 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607741    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9301da60-53ca-42ef-82d0-675b085ca798-konnectivity-ca\") pod \"konnectivity-agent-vckm7\" (UID: \"9301da60-53ca-42ef-82d0-675b085ca798\") " pod="kube-system/konnectivity-agent-vckm7"
Jul 29 10:29:12.608342 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607768    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c1c684b-d479-45fe-86de-d8e46d15e563-env-overrides\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.608342 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607800    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbxxv\" (UniqueName: \"kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv\") pod \"network-check-target-44zb2\" (UID: \"5b84c737-c010-44f8-a233-ad9585234e65\") " pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:12.608342 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607824    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-run-openvswitch\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.608342 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607826    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-etc-openvswitch\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.608342 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607860    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-etc-openvswitch\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.608342 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607862    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-run-ovn-kubernetes\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.608342 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607903    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-cni-netd\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.608342 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607906    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-run-ovn-kubernetes\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.608342 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607929    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c1c684b-d479-45fe-86de-d8e46d15e563-ovnkube-config\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.608342 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607954    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c1c684b-d479-45fe-86de-d8e46d15e563-ovn-node-metrics-cert\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.608342 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.607970    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1601bb23-ae66-4343-9f8f-abd8400aae58-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.608342 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.608011    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.608342 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.608046    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c1c684b-d479-45fe-86de-d8e46d15e563-ovnkube-script-lib\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.608342 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.608073    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9301da60-53ca-42ef-82d0-675b085ca798-agent-certs\") pod \"konnectivity-agent-vckm7\" (UID: \"9301da60-53ca-42ef-82d0-675b085ca798\") " pod="kube-system/konnectivity-agent-vckm7"
Jul 29 10:29:12.608342 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.608098    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-run-netns\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.608342 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.608127    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-systemd-units\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.608342 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.608150    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-slash\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.609015 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.608181    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-var-lib-openvswitch\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.609015 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.608263    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-run-systemd\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.609015 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.608523    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-run-ovn\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.609015 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.608570    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-kubelet\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.609015 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.608696    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-node-log\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.609015 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.608689    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1601bb23-ae66-4343-9f8f-abd8400aae58-socket-dir\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.609015 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.608820    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1601bb23-ae66-4343-9f8f-abd8400aae58-etc-selinux\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.609015 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.608937    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c1c684b-d479-45fe-86de-d8e46d15e563-ovnkube-config\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.609448 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.608020    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1601bb23-ae66-4343-9f8f-abd8400aae58-registration-dir\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.609448 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.609175    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.609448 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:12.609235    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 10:29:12.609448 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:12.609308    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs podName:4f79fb8a-c882-40cf-bffd-6685e5b15c8b nodeName:}" failed. No retries permitted until 2026-07-29 10:29:13.109274246 +0000 UTC m=+3.054513086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs") pod "network-metrics-daemon-csxgd" (UID: "4f79fb8a-c882-40cf-bffd-6685e5b15c8b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 10:29:12.609448 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.609370    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1601bb23-ae66-4343-9f8f-abd8400aae58-sys-fs\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.609916 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.609861    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c1c684b-d479-45fe-86de-d8e46d15e563-env-overrides\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.610038 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.609928    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-cni-netd\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.610038 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.609974    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-slash\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.610038 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.610011    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-host-run-netns\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.610218 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.610051    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-systemd-units\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.610218 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.610095    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-var-lib-openvswitch\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.610218 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.610122    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c1c684b-d479-45fe-86de-d8e46d15e563-ovnkube-script-lib\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.610218 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.610138    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c1c684b-d479-45fe-86de-d8e46d15e563-node-log\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.610415 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.610378    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9301da60-53ca-42ef-82d0-675b085ca798-konnectivity-ca\") pod \"konnectivity-agent-vckm7\" (UID: \"9301da60-53ca-42ef-82d0-675b085ca798\") " pod="kube-system/konnectivity-agent-vckm7"
Jul 29 10:29:12.612174 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.612148    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9301da60-53ca-42ef-82d0-675b085ca798-agent-certs\") pod \"konnectivity-agent-vckm7\" (UID: \"9301da60-53ca-42ef-82d0-675b085ca798\") " pod="kube-system/konnectivity-agent-vckm7"
Jul 29 10:29:12.612358 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.612337    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c1c684b-d479-45fe-86de-d8e46d15e563-ovn-node-metrics-cert\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.618921 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:12.618863    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 10:29:12.618921 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:12.618907    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 10:29:12.618921 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:12.618922    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sbxxv for pod openshift-network-diagnostics/network-check-target-44zb2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 10:29:12.619129 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:12.619016    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv podName:5b84c737-c010-44f8-a233-ad9585234e65 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:13.1189992 +0000 UTC m=+3.064238038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sbxxv" (UniqueName: "kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv") pod "network-check-target-44zb2" (UID: "5b84c737-c010-44f8-a233-ad9585234e65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 10:29:12.623235 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.623204    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbckv\" (UniqueName: \"kubernetes.io/projected/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-kube-api-access-cbckv\") pod \"network-metrics-daemon-csxgd\" (UID: \"4f79fb8a-c882-40cf-bffd-6685e5b15c8b\") " pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:12.626602 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.626575    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw4fc\" (UniqueName: \"kubernetes.io/projected/1601bb23-ae66-4343-9f8f-abd8400aae58-kube-api-access-gw4fc\") pod \"aws-ebs-csi-driver-node-ckvfn\" (UID: \"1601bb23-ae66-4343-9f8f-abd8400aae58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:12.627847 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.627815    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwgqm\" (UniqueName: \"kubernetes.io/projected/0c1c684b-d479-45fe-86de-d8e46d15e563-kube-api-access-qwgqm\") pod \"ovnkube-node-txz46\" (UID: \"0c1c684b-d479-45fe-86de-d8e46d15e563\") " pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.691364 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.691329    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-plh6r"
Jul 29 10:29:12.699902 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.699873    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9n26w"
Jul 29 10:29:12.709861 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.709834    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f5jjn"
Jul 29 10:29:12.714819 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.714787    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-np8dd"
Jul 29 10:29:12.722815 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.722791    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2p7vc"
Jul 29 10:29:12.735840 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.735815    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bhfd5"
Jul 29 10:29:12.743492 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.743456    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vckm7"
Jul 29 10:29:12.755387 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.755354    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:12.761346 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:12.761319    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn"
Jul 29 10:29:13.012765 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:13.012670    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret\") pod \"global-pull-secret-syncer-xvrhp\" (UID: \"b026f57e-f993-4257-8732-63e69c9aaa3c\") " pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:13.012894 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:13.012804    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 10:29:13.012894 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:13.012862    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret podName:b026f57e-f993-4257-8732-63e69c9aaa3c nodeName:}" failed. No retries permitted until 2026-07-29 10:29:14.012847213 +0000 UTC m=+3.958086038 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret") pod "global-pull-secret-syncer-xvrhp" (UID: "b026f57e-f993-4257-8732-63e69c9aaa3c") : object "kube-system"/"original-pull-secret" not registered
Jul 29 10:29:13.113310 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:13.113267    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs\") pod \"network-metrics-daemon-csxgd\" (UID: \"4f79fb8a-c882-40cf-bffd-6685e5b15c8b\") " pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:13.113464 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:13.113402    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 10:29:13.113534 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:13.113471    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs podName:4f79fb8a-c882-40cf-bffd-6685e5b15c8b nodeName:}" failed. No retries permitted until 2026-07-29 10:29:14.113453397 +0000 UTC m=+4.058692223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs") pod "network-metrics-daemon-csxgd" (UID: "4f79fb8a-c882-40cf-bffd-6685e5b15c8b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 10:29:13.214308 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:13.214266    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbxxv\" (UniqueName: \"kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv\") pod \"network-check-target-44zb2\" (UID: \"5b84c737-c010-44f8-a233-ad9585234e65\") " pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:13.214491 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:13.214452    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 10:29:13.214491 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:13.214479    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 10:29:13.214592 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:13.214493    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sbxxv for pod openshift-network-diagnostics/network-check-target-44zb2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 10:29:13.214592 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:13.214563    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv podName:5b84c737-c010-44f8-a233-ad9585234e65 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:14.214542881 +0000 UTC m=+4.159781725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sbxxv" (UniqueName: "kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv") pod "network-check-target-44zb2" (UID: "5b84c737-c010-44f8-a233-ad9585234e65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 10:29:13.526543 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:13.526484    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 10:24:12 +0000 UTC" deadline="2028-04-01 01:49:02.915640483 +0000 UTC"
Jul 29 10:29:13.526543 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:13.526541    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14679h19m49.389105364s"
Jul 29 10:29:13.556912 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:13.556885    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:13.557081 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:13.557013    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:13.655917 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:13.655886    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2600cf4_d12b_403e_bf31_5ce050c118ef.slice/crio-7610afd51f5ab37d1389466c7223afe0355344f2ccc1a59a8598b3b241d4500a WatchSource:0}: Error finding container 7610afd51f5ab37d1389466c7223afe0355344f2ccc1a59a8598b3b241d4500a: Status 404 returned error can't find the container with id 7610afd51f5ab37d1389466c7223afe0355344f2ccc1a59a8598b3b241d4500a
Jul 29 10:29:13.673895 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:13.673856    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod457f5f29_b9d3_4c9e_a703_53e304308abe.slice/crio-642797911c2efc17f3a5826df66f4dadd9d7c2643f0ea06b255510c23145cb3c WatchSource:0}: Error finding container 642797911c2efc17f3a5826df66f4dadd9d7c2643f0ea06b255510c23145cb3c: Status 404 returned error can't find the container with id 642797911c2efc17f3a5826df66f4dadd9d7c2643f0ea06b255510c23145cb3c
Jul 29 10:29:13.674648 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:13.674630    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c1c684b_d479_45fe_86de_d8e46d15e563.slice/crio-ddc6e36dec805e9dc6efeef9de72e6f68b6de4d17657528211166455cdd98da0 WatchSource:0}: Error finding container ddc6e36dec805e9dc6efeef9de72e6f68b6de4d17657528211166455cdd98da0: Status 404 returned error can't find the container with id ddc6e36dec805e9dc6efeef9de72e6f68b6de4d17657528211166455cdd98da0
Jul 29 10:29:13.675400 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:13.675357    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be1c095_4863_402e_bdf9_d00c0b4fe490.slice/crio-711dcf59ec9501e644e2c3f93970472be6fee8c537b8007e02e4f037adc4248b WatchSource:0}: Error finding container 711dcf59ec9501e644e2c3f93970472be6fee8c537b8007e02e4f037adc4248b: Status 404 returned error can't find the container with id 711dcf59ec9501e644e2c3f93970472be6fee8c537b8007e02e4f037adc4248b
Jul 29 10:29:13.676794 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:13.676776    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1601bb23_ae66_4343_9f8f_abd8400aae58.slice/crio-910edb19a1742e9e68da4a9da9ac904e4ea87e25952c453f6f100146396e8245 WatchSource:0}: Error finding container 910edb19a1742e9e68da4a9da9ac904e4ea87e25952c453f6f100146396e8245: Status 404 returned error can't find the container with id 910edb19a1742e9e68da4a9da9ac904e4ea87e25952c453f6f100146396e8245
Jul 29 10:29:13.678590 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:13.678479    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9301da60_53ca_42ef_82d0_675b085ca798.slice/crio-af1e1c1e7e2e7091fb698dfa98165fd3206a1321ec5476a7a9fc482bc47613cb WatchSource:0}: Error finding container af1e1c1e7e2e7091fb698dfa98165fd3206a1321ec5476a7a9fc482bc47613cb: Status 404 returned error can't find the container with id af1e1c1e7e2e7091fb698dfa98165fd3206a1321ec5476a7a9fc482bc47613cb
Jul 29 10:29:13.679598 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:13.679190    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2c35c22_9057_4ecb_8fa3_47630fc253c6.slice/crio-4ee944e45fbda2f1618f56725f60c703e4a339a71a81ddd70c195c4e22decd88 WatchSource:0}: Error finding container 4ee944e45fbda2f1618f56725f60c703e4a339a71a81ddd70c195c4e22decd88: Status 404 returned error can't find the container with id 4ee944e45fbda2f1618f56725f60c703e4a339a71a81ddd70c195c4e22decd88
Jul 29 10:29:13.680063 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:13.680025    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7f5588f_daf4_465c_89f2_5324a87b79db.slice/crio-caf12e3e5e24b908ea4d54abe44099f8a750f6677c00a9de9cc38944143dfbc0 WatchSource:0}: Error finding container caf12e3e5e24b908ea4d54abe44099f8a750f6677c00a9de9cc38944143dfbc0: Status 404 returned error can't find the container with id caf12e3e5e24b908ea4d54abe44099f8a750f6677c00a9de9cc38944143dfbc0
Jul 29 10:29:13.681298 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:13.681226    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd6d091a_bfcf_4c05_b9ec_9b9fce47117a.slice/crio-059a7f2d40d5887c2da4aa282761277c6aec10f14ff2c37597a3bddc84989e9a WatchSource:0}: Error finding container 059a7f2d40d5887c2da4aa282761277c6aec10f14ff2c37597a3bddc84989e9a: Status 404 returned error can't find the container with id 059a7f2d40d5887c2da4aa282761277c6aec10f14ff2c37597a3bddc84989e9a
Jul 29 10:29:14.021032 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:14.020999    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret\") pod \"global-pull-secret-syncer-xvrhp\" (UID: \"b026f57e-f993-4257-8732-63e69c9aaa3c\") " pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:14.021196 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:14.021165    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 10:29:14.021241 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:14.021234    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret podName:b026f57e-f993-4257-8732-63e69c9aaa3c nodeName:}" failed. No retries permitted until 2026-07-29 10:29:16.021219557 +0000 UTC m=+5.966458381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret") pod "global-pull-secret-syncer-xvrhp" (UID: "b026f57e-f993-4257-8732-63e69c9aaa3c") : object "kube-system"/"original-pull-secret" not registered
Jul 29 10:29:14.122423 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:14.121649    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs\") pod \"network-metrics-daemon-csxgd\" (UID: \"4f79fb8a-c882-40cf-bffd-6685e5b15c8b\") " pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:14.122423 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:14.121959    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 10:29:14.122423 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:14.122024    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs podName:4f79fb8a-c882-40cf-bffd-6685e5b15c8b nodeName:}" failed. No retries permitted until 2026-07-29 10:29:16.122005333 +0000 UTC m=+6.067244160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs") pod "network-metrics-daemon-csxgd" (UID: "4f79fb8a-c882-40cf-bffd-6685e5b15c8b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 10:29:14.222476 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:14.222434    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbxxv\" (UniqueName: \"kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv\") pod \"network-check-target-44zb2\" (UID: \"5b84c737-c010-44f8-a233-ad9585234e65\") " pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:14.222653 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:14.222642    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 10:29:14.222709 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:14.222663    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 10:29:14.222709 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:14.222676    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sbxxv for pod openshift-network-diagnostics/network-check-target-44zb2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 10:29:14.222823 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:14.222749    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv podName:5b84c737-c010-44f8-a233-ad9585234e65 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:16.222729927 +0000 UTC m=+6.167968772 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sbxxv" (UniqueName: "kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv") pod "network-check-target-44zb2" (UID: "5b84c737-c010-44f8-a233-ad9585234e65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 10:29:14.527088 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:14.527025    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 10:24:12 +0000 UTC" deadline="2028-04-23 13:14:25.49242803 +0000 UTC"
Jul 29 10:29:14.527088 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:14.527086    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15218h45m10.965345594s"
Jul 29 10:29:14.557866 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:14.557829    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:14.558039 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:14.557970    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:14.560627 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:14.560451    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:14.560627 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:14.560549    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:14.572983 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:14.572267    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal" event={"ID":"aead170e01fe516b4b3c2976153a38af","Type":"ContainerStarted","Data":"f79746b7e4ccb93e31c3ebc4967e67e284d9f85a03ec9d5ac738e73d66ef937b"}
Jul 29 10:29:14.578795 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:14.578701    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f5jjn" event={"ID":"c7f5588f-daf4-465c-89f2-5324a87b79db","Type":"ContainerStarted","Data":"caf12e3e5e24b908ea4d54abe44099f8a750f6677c00a9de9cc38944143dfbc0"}
Jul 29 10:29:14.580894 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:14.580825    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2p7vc" event={"ID":"a2c35c22-9057-4ecb-8fa3-47630fc253c6","Type":"ContainerStarted","Data":"4ee944e45fbda2f1618f56725f60c703e4a339a71a81ddd70c195c4e22decd88"}
Jul 29 10:29:14.582442 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:14.582358    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vckm7" event={"ID":"9301da60-53ca-42ef-82d0-675b085ca798","Type":"ContainerStarted","Data":"af1e1c1e7e2e7091fb698dfa98165fd3206a1321ec5476a7a9fc482bc47613cb"}
Jul 29 10:29:14.585144 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:14.585061    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn" event={"ID":"1601bb23-ae66-4343-9f8f-abd8400aae58","Type":"ContainerStarted","Data":"910edb19a1742e9e68da4a9da9ac904e4ea87e25952c453f6f100146396e8245"}
Jul 29 10:29:14.589108 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:14.589061    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal" podStartSLOduration=2.589045193 podStartE2EDuration="2.589045193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:14.588507709 +0000 UTC m=+4.533746570" watchObservedRunningTime="2026-07-29 10:29:14.589045193 +0000 UTC m=+4.534284041"
Jul 29 10:29:14.593249 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:14.593225    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-txz46" event={"ID":"0c1c684b-d479-45fe-86de-d8e46d15e563","Type":"ContainerStarted","Data":"ddc6e36dec805e9dc6efeef9de72e6f68b6de4d17657528211166455cdd98da0"}
Jul 29 10:29:14.599297 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:14.599270    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n26w" event={"ID":"457f5f29-b9d3-4c9e-a703-53e304308abe","Type":"ContainerStarted","Data":"642797911c2efc17f3a5826df66f4dadd9d7c2643f0ea06b255510c23145cb3c"}
Jul 29 10:29:14.602157 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:14.602131    2567 generic.go:356] "Generic (PLEG): container finished" podID="37ed332b69ac514232dfbedf893cd802" containerID="6b1d0f439eacf63201c66612e7cc10c90d97f07db5ce24b10e3fc9b644450b6c" exitCode=0
Jul 29 10:29:14.602256 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:14.602229    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal" event={"ID":"37ed332b69ac514232dfbedf893cd802","Type":"ContainerDied","Data":"6b1d0f439eacf63201c66612e7cc10c90d97f07db5ce24b10e3fc9b644450b6c"}
Jul 29 10:29:14.605778 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:14.605697    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bhfd5" event={"ID":"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a","Type":"ContainerStarted","Data":"059a7f2d40d5887c2da4aa282761277c6aec10f14ff2c37597a3bddc84989e9a"}
Jul 29 10:29:14.616454 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:14.615821    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-np8dd" event={"ID":"2be1c095-4863-402e-bdf9-d00c0b4fe490","Type":"ContainerStarted","Data":"711dcf59ec9501e644e2c3f93970472be6fee8c537b8007e02e4f037adc4248b"}
Jul 29 10:29:14.618949 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:14.618891    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-plh6r" event={"ID":"b2600cf4-d12b-403e-bf31-5ce050c118ef","Type":"ContainerStarted","Data":"7610afd51f5ab37d1389466c7223afe0355344f2ccc1a59a8598b3b241d4500a"}
Jul 29 10:29:15.557272 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:15.557228    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:15.557840 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:15.557375    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:15.641034 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:15.640961    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal" event={"ID":"37ed332b69ac514232dfbedf893cd802","Type":"ContainerStarted","Data":"646d7129ad195aa4fc85f31a9d38fc1a20afdb9f30667dddcb5de30a51d2d454"}
Jul 29 10:29:16.039185 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:16.038521    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret\") pod \"global-pull-secret-syncer-xvrhp\" (UID: \"b026f57e-f993-4257-8732-63e69c9aaa3c\") " pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:16.039185 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:16.038691    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 10:29:16.039185 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:16.038771    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret podName:b026f57e-f993-4257-8732-63e69c9aaa3c nodeName:}" failed. No retries permitted until 2026-07-29 10:29:20.038754129 +0000 UTC m=+9.983992974 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret") pod "global-pull-secret-syncer-xvrhp" (UID: "b026f57e-f993-4257-8732-63e69c9aaa3c") : object "kube-system"/"original-pull-secret" not registered
Jul 29 10:29:16.140093 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:16.139450    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs\") pod \"network-metrics-daemon-csxgd\" (UID: \"4f79fb8a-c882-40cf-bffd-6685e5b15c8b\") " pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:16.140093 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:16.139679    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 10:29:16.140093 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:16.139757    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs podName:4f79fb8a-c882-40cf-bffd-6685e5b15c8b nodeName:}" failed. No retries permitted until 2026-07-29 10:29:20.139737088 +0000 UTC m=+10.084975937 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs") pod "network-metrics-daemon-csxgd" (UID: "4f79fb8a-c882-40cf-bffd-6685e5b15c8b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 10:29:16.240469 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:16.240428    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbxxv\" (UniqueName: \"kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv\") pod \"network-check-target-44zb2\" (UID: \"5b84c737-c010-44f8-a233-ad9585234e65\") " pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:16.240658 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:16.240641    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 10:29:16.240763 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:16.240662    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 10:29:16.240763 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:16.240674    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sbxxv for pod openshift-network-diagnostics/network-check-target-44zb2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 10:29:16.240763 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:16.240745    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv podName:5b84c737-c010-44f8-a233-ad9585234e65 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:20.240727818 +0000 UTC m=+10.185966656 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sbxxv" (UniqueName: "kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv") pod "network-check-target-44zb2" (UID: "5b84c737-c010-44f8-a233-ad9585234e65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 10:29:16.559915 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:16.559218    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:16.559915 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:16.559364    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:16.559915 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:16.559761    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:16.559915 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:16.559859    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:17.556585 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:17.556530    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:17.556806 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:17.556660    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:18.556764 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:18.556730    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:18.557213 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:18.556883    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:18.557213 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:18.557163    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:18.557332 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:18.557263    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:19.557401 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:19.556916    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:19.557401 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:19.557049    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:20.075092 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:20.075054    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret\") pod \"global-pull-secret-syncer-xvrhp\" (UID: \"b026f57e-f993-4257-8732-63e69c9aaa3c\") " pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:20.075251 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:20.075221    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 10:29:20.075381 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:20.075302    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret podName:b026f57e-f993-4257-8732-63e69c9aaa3c nodeName:}" failed. No retries permitted until 2026-07-29 10:29:28.075281581 +0000 UTC m=+18.020520407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret") pod "global-pull-secret-syncer-xvrhp" (UID: "b026f57e-f993-4257-8732-63e69c9aaa3c") : object "kube-system"/"original-pull-secret" not registered
Jul 29 10:29:20.176045 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:20.176001    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs\") pod \"network-metrics-daemon-csxgd\" (UID: \"4f79fb8a-c882-40cf-bffd-6685e5b15c8b\") " pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:20.176228 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:20.176178    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 10:29:20.176289 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:20.176258    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs podName:4f79fb8a-c882-40cf-bffd-6685e5b15c8b nodeName:}" failed. No retries permitted until 2026-07-29 10:29:28.176236817 +0000 UTC m=+18.121475658 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs") pod "network-metrics-daemon-csxgd" (UID: "4f79fb8a-c882-40cf-bffd-6685e5b15c8b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 10:29:20.276892 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:20.276853    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbxxv\" (UniqueName: \"kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv\") pod \"network-check-target-44zb2\" (UID: \"5b84c737-c010-44f8-a233-ad9585234e65\") " pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:20.277100 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:20.277082    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 10:29:20.277100 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:20.277102    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 10:29:20.277212 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:20.277112    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sbxxv for pod openshift-network-diagnostics/network-check-target-44zb2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 10:29:20.277212 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:20.277164    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv podName:5b84c737-c010-44f8-a233-ad9585234e65 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:28.277151991 +0000 UTC m=+18.222390814 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sbxxv" (UniqueName: "kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv") pod "network-check-target-44zb2" (UID: "5b84c737-c010-44f8-a233-ad9585234e65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 10:29:20.559206 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:20.558907    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:20.559206 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:20.559024    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:20.559206 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:20.559132    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:20.565402 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:20.562883    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:21.557072 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:21.557038    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:21.557240 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:21.557179    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:22.557298 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:22.556723    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:22.557298 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:22.556879    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:22.557955 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:22.557927    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:22.558069 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:22.558036    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:23.557303 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:23.557266    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:23.557779 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:23.557401    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:24.559794 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:24.559765    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:24.559794 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:24.559786    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:24.560179 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:24.559865    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:24.560179 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:24.559982    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:25.556942 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:25.556910    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:25.557118 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:25.557030    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:26.557413 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:26.557375    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:26.557901 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:26.557432    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:26.557901 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:26.557517    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:26.557901 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:26.557645    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:27.557276 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:27.557239    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:27.557503 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:27.557362    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:28.137338 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:28.137297    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret\") pod \"global-pull-secret-syncer-xvrhp\" (UID: \"b026f57e-f993-4257-8732-63e69c9aaa3c\") " pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:28.137500 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:28.137451    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 10:29:28.137539 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:28.137513    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret podName:b026f57e-f993-4257-8732-63e69c9aaa3c nodeName:}" failed. No retries permitted until 2026-07-29 10:29:44.137496655 +0000 UTC m=+34.082735499 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret") pod "global-pull-secret-syncer-xvrhp" (UID: "b026f57e-f993-4257-8732-63e69c9aaa3c") : object "kube-system"/"original-pull-secret" not registered
Jul 29 10:29:28.237905 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:28.237866    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs\") pod \"network-metrics-daemon-csxgd\" (UID: \"4f79fb8a-c882-40cf-bffd-6685e5b15c8b\") " pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:28.238079 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:28.238000    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 10:29:28.238079 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:28.238070    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs podName:4f79fb8a-c882-40cf-bffd-6685e5b15c8b nodeName:}" failed. No retries permitted until 2026-07-29 10:29:44.238051573 +0000 UTC m=+34.183290400 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs") pod "network-metrics-daemon-csxgd" (UID: "4f79fb8a-c882-40cf-bffd-6685e5b15c8b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 10:29:28.338777 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:28.338748    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbxxv\" (UniqueName: \"kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv\") pod \"network-check-target-44zb2\" (UID: \"5b84c737-c010-44f8-a233-ad9585234e65\") " pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:28.338949 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:28.338931    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 10:29:28.338997 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:28.338957    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 10:29:28.338997 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:28.338971    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sbxxv for pod openshift-network-diagnostics/network-check-target-44zb2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 10:29:28.339123 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:28.339016    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv podName:5b84c737-c010-44f8-a233-ad9585234e65 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:44.339003118 +0000 UTC m=+34.284241946 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sbxxv" (UniqueName: "kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv") pod "network-check-target-44zb2" (UID: "5b84c737-c010-44f8-a233-ad9585234e65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 10:29:28.557357 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:28.557279    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:28.557528 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:28.557279    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:28.557528 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:28.557422    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:28.557528 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:28.557501    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:29.556962 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:29.556930    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:29.557135 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:29.557042    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:30.557794 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:30.557752    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:30.558246 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:30.557752    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:30.558246 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:30.557883    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:30.558246 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:30.557925    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:31.556544 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:31.556518    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:31.556696 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:31.556633    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:32.557034 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:32.556599    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:32.557792 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:32.556650    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:32.557792 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:32.557178    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:32.557792 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:32.557277    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:32.677314 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:32.677283    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f5jjn" event={"ID":"c7f5588f-daf4-465c-89f2-5324a87b79db","Type":"ContainerStarted","Data":"358370e7bf3fbd76ea29f85ee846db0525dc01f879fdf0d18d5f9d64056a4949"}
Jul 29 10:29:32.678728 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:32.678695    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2p7vc" event={"ID":"a2c35c22-9057-4ecb-8fa3-47630fc253c6","Type":"ContainerStarted","Data":"b7da2bbff1cca78afdcbc9f414bfe044a762f79fdef133b0217a2adb6a2370a9"}
Jul 29 10:29:32.680184 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:32.680157    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vckm7" event={"ID":"9301da60-53ca-42ef-82d0-675b085ca798","Type":"ContainerStarted","Data":"f653ae7fb2a0fff3d962942a264d584f810f0dc36908bddfb846a25409276540"}
Jul 29 10:29:32.681599 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:32.681580    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn" event={"ID":"1601bb23-ae66-4343-9f8f-abd8400aae58","Type":"ContainerStarted","Data":"ca71a4f0c0a43c73a3e971f159ba379a402d93497cde0555bf4671d0eb6354fe"}
Jul 29 10:29:32.683854 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:32.683821    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-txz46" event={"ID":"0c1c684b-d479-45fe-86de-d8e46d15e563","Type":"ContainerStarted","Data":"aed1216e88e1e6bcfcf435a4a5a96f287fc01e6735d85807ca0eaf7b7304bc54"}
Jul 29 10:29:32.683941 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:32.683895    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-txz46" event={"ID":"0c1c684b-d479-45fe-86de-d8e46d15e563","Type":"ContainerStarted","Data":"d48c4f504595ac74d43bd0d5d6a9876b310148464ceaea4dddc3f5c6b4d7a5cf"}
Jul 29 10:29:32.683990 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:32.683941    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-txz46" event={"ID":"0c1c684b-d479-45fe-86de-d8e46d15e563","Type":"ContainerStarted","Data":"0175f2736ee22cebac942cd6056ad00837eebf874fbe5e7b79f6a86dc803b598"}
Jul 29 10:29:32.683990 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:32.683976    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-txz46" event={"ID":"0c1c684b-d479-45fe-86de-d8e46d15e563","Type":"ContainerStarted","Data":"e4a7a39c78d8a5f643f7323cca287d4d0b2021fdbab96d960913c3a1b27c09e9"}
Jul 29 10:29:32.685219 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:32.685199    2567 generic.go:356] "Generic (PLEG): container finished" podID="457f5f29-b9d3-4c9e-a703-53e304308abe" containerID="ae51b1c727d6b85c3a138ea024b7526854ecf459c2acea0856b07bf0bda7c397" exitCode=0
Jul 29 10:29:32.685305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:32.685277    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n26w" event={"ID":"457f5f29-b9d3-4c9e-a703-53e304308abe","Type":"ContainerDied","Data":"ae51b1c727d6b85c3a138ea024b7526854ecf459c2acea0856b07bf0bda7c397"}
Jul 29 10:29:32.686638 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:32.686600    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bhfd5" event={"ID":"cd6d091a-bfcf-4c05-b9ec-9b9fce47117a","Type":"ContainerStarted","Data":"30c992e98e782f601afc387e2a52318d6949cef67f2e18b2ea11b56b7a186e00"}
Jul 29 10:29:32.687932 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:32.687837    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-np8dd" event={"ID":"2be1c095-4863-402e-bdf9-d00c0b4fe490","Type":"ContainerStarted","Data":"aef2fd8a3d1ccb6d4b75814487aa5cd367d6839b6ff8248501fb346036b9e724"}
Jul 29 10:29:32.698183 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:32.697827    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal" podStartSLOduration=21.697789109 podStartE2EDuration="21.697789109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:15.659582404 +0000 UTC m=+5.604821251" watchObservedRunningTime="2026-07-29 10:29:32.697789109 +0000 UTC m=+22.643027955"
Jul 29 10:29:32.698606 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:32.698572    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f5jjn" podStartSLOduration=4.130619755 podStartE2EDuration="22.698561504s" totalImagesPullingTime="18.567941749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:32.697876392 +0000 UTC m=+22.643115259" watchObservedRunningTime="2026-07-29 10:29:32.698561504 +0000 UTC m=+22.643800346"
Jul 29 10:29:32.743417 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:32.743360    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2p7vc" podStartSLOduration=4.188246723 podStartE2EDuration="22.74334538s" totalImagesPullingTime="18.555098657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:32.742774179 +0000 UTC m=+22.688013046" watchObservedRunningTime="2026-07-29 10:29:32.74334538 +0000 UTC m=+22.688584226"
Jul 29 10:29:32.759576 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:32.759508    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-np8dd" podStartSLOduration=4.200799171 podStartE2EDuration="22.759485354s" totalImagesPullingTime="18.558686183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:32.758872498 +0000 UTC m=+22.704111344" watchObservedRunningTime="2026-07-29 10:29:32.759485354 +0000 UTC m=+22.704724202"
Jul 29 10:29:32.795365 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:32.795325    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bhfd5" podStartSLOduration=4.18918744 podStartE2EDuration="22.795307954s" totalImagesPullingTime="18.606120514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:32.77855767 +0000 UTC m=+22.723796518" watchObservedRunningTime="2026-07-29 10:29:32.795307954 +0000 UTC m=+22.740546812"
Jul 29 10:29:32.795893 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:32.795862    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vckm7" podStartSLOduration=8.138290437 podStartE2EDuration="22.795851123s" totalImagesPullingTime="14.657560686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:32.795106182 +0000 UTC m=+22.740345024" watchObservedRunningTime="2026-07-29 10:29:32.795851123 +0000 UTC m=+22.741089968"
Jul 29 10:29:33.489132 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:33.489096    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vckm7"
Jul 29 10:29:33.490081 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:33.490055    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vckm7"
Jul 29 10:29:33.556940 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:33.556900    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:33.557059 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:33.557010    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:33.647343 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:33.647314    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 10:29:33.691489 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:33.691449    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-plh6r" event={"ID":"b2600cf4-d12b-403e-bf31-5ce050c118ef","Type":"ContainerStarted","Data":"fd595b30df4da7070ed862f914c477e00b8200233527df61ee44e7ee8cf0e97b"}
Jul 29 10:29:33.693575 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:33.693547    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn" event={"ID":"1601bb23-ae66-4343-9f8f-abd8400aae58","Type":"ContainerStarted","Data":"89cc0025eb8b7c05c56be32e4555be42350ed34b178a8d7157a14034e0d6479a"}
Jul 29 10:29:33.697152 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:33.697108    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-txz46" event={"ID":"0c1c684b-d479-45fe-86de-d8e46d15e563","Type":"ContainerStarted","Data":"05d106d82c28c14a63d3d8c01dec090ce08477d4beae02ea33bcf7ae04eb19e2"}
Jul 29 10:29:33.697286 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:33.697193    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-txz46" event={"ID":"0c1c684b-d479-45fe-86de-d8e46d15e563","Type":"ContainerStarted","Data":"9adc60b82f17ac368be684699e44c3e0e074ca8bd9a46882e955a614c807f928"}
Jul 29 10:29:33.697705 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:33.697681    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vckm7"
Jul 29 10:29:33.698212 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:33.698195    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vckm7"
Jul 29 10:29:33.709022 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:33.708955    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-plh6r" podStartSLOduration=5.140674291 podStartE2EDuration="23.708941797s" totalImagesPullingTime="18.568267506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:33.708294694 +0000 UTC m=+23.653533540" watchObservedRunningTime="2026-07-29 10:29:33.708941797 +0000 UTC m=+23.654180643"
Jul 29 10:29:34.464881 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:34.464734    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T10:29:33.647333605Z","UUID":"bfec0a3f-9d88-4e7b-85b1-8692436d48cc","Handler":null,"Name":"","Endpoint":""}
Jul 29 10:29:34.466671 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:34.466647    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 10:29:34.466833 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:34.466692    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 10:29:34.557998 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:34.557786    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:34.558459 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:34.557854    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:34.558459 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:34.558158    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:34.558459 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:34.558386    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:35.556595 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:35.556561    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:35.556794 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:35.556676    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:35.703703 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:35.703668    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn" event={"ID":"1601bb23-ae66-4343-9f8f-abd8400aae58","Type":"ContainerStarted","Data":"ad46b133f417e9e318d6f3067156caaec6e009372196f3d39eb129e9f88a9703"}
Jul 29 10:29:35.707757 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:35.707729    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-txz46" event={"ID":"0c1c684b-d479-45fe-86de-d8e46d15e563","Type":"ContainerStarted","Data":"b3eb73637b19309b617b854a8a852a7a9a104ca8502b2248766ba86db8c30edc"}
Jul 29 10:29:35.722180 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:35.722135    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ckvfn" podStartSLOduration=4.929698408 podStartE2EDuration="25.72211572s" totalImagesPullingTime="20.792417312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:35.72178321 +0000 UTC m=+25.667022074" watchObservedRunningTime="2026-07-29 10:29:35.72211572 +0000 UTC m=+25.667354565"
Jul 29 10:29:36.557450 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:36.557245    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:36.557645 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:36.557317    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:36.557645 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:36.557542    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:36.557792 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:36.557654    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:37.556491 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:37.556462    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:37.557196 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:37.556569    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:37.714870 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:37.714835    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-txz46" event={"ID":"0c1c684b-d479-45fe-86de-d8e46d15e563","Type":"ContainerStarted","Data":"9f687257457cc867f89f636de34d148fc1b976a74233d1d70df73d7b1802b2b1"}
Jul 29 10:29:37.715117 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:37.715096    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:37.715238 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:37.715171    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:37.719676 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:37.719649    2567 generic.go:356] "Generic (PLEG): container finished" podID="457f5f29-b9d3-4c9e-a703-53e304308abe" containerID="07db6f20c26897597635f42ed638c412c96a60ec4d9417c553c1641a7167f2bc" exitCode=0
Jul 29 10:29:37.719816 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:37.719685    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n26w" event={"ID":"457f5f29-b9d3-4c9e-a703-53e304308abe","Type":"ContainerDied","Data":"07db6f20c26897597635f42ed638c412c96a60ec4d9417c553c1641a7167f2bc"}
Jul 29 10:29:37.732127 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:37.732098    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:37.748077 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:37.748033    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-txz46" podStartSLOduration=9.129191979 podStartE2EDuration="27.748017605s" totalImagesPullingTime="18.618825626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:37.747634186 +0000 UTC m=+27.692873081" watchObservedRunningTime="2026-07-29 10:29:37.748017605 +0000 UTC m=+27.693256451"
Jul 29 10:29:38.559951 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:38.559913    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:38.560409 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:38.560014    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:38.560409 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:38.560072    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:38.560409 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:38.560196    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:38.722472 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:38.722228    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:38.738572 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:38.738546    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:29:39.556680 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:39.556590    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:39.556865 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:39.556706    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:39.729509 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:39.729476    2567 generic.go:356] "Generic (PLEG): container finished" podID="457f5f29-b9d3-4c9e-a703-53e304308abe" containerID="3fec10a50877c464355e1fcb5e2d5cfccef5fcd14dbe30e6e854fdac497d1065" exitCode=0
Jul 29 10:29:39.729895 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:39.729563    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n26w" event={"ID":"457f5f29-b9d3-4c9e-a703-53e304308abe","Type":"ContainerDied","Data":"3fec10a50877c464355e1fcb5e2d5cfccef5fcd14dbe30e6e854fdac497d1065"}
Jul 29 10:29:40.558152 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:40.558108    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:40.558345 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:40.558243    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:40.558345 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:40.558290    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:40.558437 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:40.558403    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:40.734029 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:40.733997    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n26w" event={"ID":"457f5f29-b9d3-4c9e-a703-53e304308abe","Type":"ContainerStarted","Data":"ff54b5acd4cc5755e4418ef61c5e0620b293e0141f438b3506344216be53e096"}
Jul 29 10:29:41.557384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:41.557349    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:41.557580 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:41.557467    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:41.738022 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:41.737983    2567 generic.go:356] "Generic (PLEG): container finished" podID="457f5f29-b9d3-4c9e-a703-53e304308abe" containerID="ff54b5acd4cc5755e4418ef61c5e0620b293e0141f438b3506344216be53e096" exitCode=0
Jul 29 10:29:41.738393 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:41.738044    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n26w" event={"ID":"457f5f29-b9d3-4c9e-a703-53e304308abe","Type":"ContainerDied","Data":"ff54b5acd4cc5755e4418ef61c5e0620b293e0141f438b3506344216be53e096"}
Jul 29 10:29:42.556835 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:42.556792    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:42.556994 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:42.556811    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:42.556994 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:42.556928    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:42.556994 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:42.556949    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:43.556689 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:43.556655    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:43.557128 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:43.556804    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:44.161219 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:44.161185    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret\") pod \"global-pull-secret-syncer-xvrhp\" (UID: \"b026f57e-f993-4257-8732-63e69c9aaa3c\") " pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:44.161396 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:44.161315    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 10:29:44.161396 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:44.161380    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret podName:b026f57e-f993-4257-8732-63e69c9aaa3c nodeName:}" failed. No retries permitted until 2026-07-29 10:30:16.161361252 +0000 UTC m=+66.106600121 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret") pod "global-pull-secret-syncer-xvrhp" (UID: "b026f57e-f993-4257-8732-63e69c9aaa3c") : object "kube-system"/"original-pull-secret" not registered
Jul 29 10:29:44.262539 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:44.262502    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs\") pod \"network-metrics-daemon-csxgd\" (UID: \"4f79fb8a-c882-40cf-bffd-6685e5b15c8b\") " pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:44.262770 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:44.262653    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 10:29:44.262770 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:44.262732    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs podName:4f79fb8a-c882-40cf-bffd-6685e5b15c8b nodeName:}" failed. No retries permitted until 2026-07-29 10:30:16.262696857 +0000 UTC m=+66.207935692 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs") pod "network-metrics-daemon-csxgd" (UID: "4f79fb8a-c882-40cf-bffd-6685e5b15c8b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 10:29:44.362977 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:44.362944    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbxxv\" (UniqueName: \"kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv\") pod \"network-check-target-44zb2\" (UID: \"5b84c737-c010-44f8-a233-ad9585234e65\") " pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:44.363115 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:44.363099    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 10:29:44.363158 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:44.363123    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 10:29:44.363158 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:44.363134    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sbxxv for pod openshift-network-diagnostics/network-check-target-44zb2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 10:29:44.363254 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:44.363194    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv podName:5b84c737-c010-44f8-a233-ad9585234e65 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:16.363174271 +0000 UTC m=+66.308413125 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sbxxv" (UniqueName: "kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv") pod "network-check-target-44zb2" (UID: "5b84c737-c010-44f8-a233-ad9585234e65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 10:29:44.557017 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:44.556929    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:44.557017 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:44.556985    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:44.557488 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:44.557067    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:44.557488 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:44.557212    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:45.556928 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:45.556894    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:45.557116 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:45.557007    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:45.749469 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:45.749436    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n26w" event={"ID":"457f5f29-b9d3-4c9e-a703-53e304308abe","Type":"ContainerStarted","Data":"398142eefeab881bf1358dabe6f7194e1c51a9a0546f40a38f3a248adf94ce7a"}
Jul 29 10:29:46.556805 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:46.556768    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:46.556805 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:46.556800    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:46.557072 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:46.556879    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:46.557072 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:46.557003    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:46.754360 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:46.754328    2567 generic.go:356] "Generic (PLEG): container finished" podID="457f5f29-b9d3-4c9e-a703-53e304308abe" containerID="398142eefeab881bf1358dabe6f7194e1c51a9a0546f40a38f3a248adf94ce7a" exitCode=0
Jul 29 10:29:46.754763 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:46.754396    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n26w" event={"ID":"457f5f29-b9d3-4c9e-a703-53e304308abe","Type":"ContainerDied","Data":"398142eefeab881bf1358dabe6f7194e1c51a9a0546f40a38f3a248adf94ce7a"}
Jul 29 10:29:47.556870 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:47.556841    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:47.557039 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:47.556938    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:47.759022 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:47.758986    2567 generic.go:356] "Generic (PLEG): container finished" podID="457f5f29-b9d3-4c9e-a703-53e304308abe" containerID="e65165d0147c66f022c39ff8d1d5a7fafff3f2f0106667be5325e4859efe1dd3" exitCode=0
Jul 29 10:29:47.759391 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:47.759043    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n26w" event={"ID":"457f5f29-b9d3-4c9e-a703-53e304308abe","Type":"ContainerDied","Data":"e65165d0147c66f022c39ff8d1d5a7fafff3f2f0106667be5325e4859efe1dd3"}
Jul 29 10:29:48.556922 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:48.556884    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:48.557085 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:48.556928    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:48.557085 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:48.557037    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:48.557160 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:48.557143    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:48.764928 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:48.764888    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n26w" event={"ID":"457f5f29-b9d3-4c9e-a703-53e304308abe","Type":"ContainerStarted","Data":"a4e3474d3ae3e89033f3902c40f8d4142844395ae1d681dfc77e1dabb9738fa6"}
Jul 29 10:29:48.795006 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:48.794955    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9n26w" podStartSLOduration=9.770010731 podStartE2EDuration="38.794940347s" totalImagesPullingTime="29.024929616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:48.7943511 +0000 UTC m=+38.739589970" watchObservedRunningTime="2026-07-29 10:29:48.794940347 +0000 UTC m=+38.740179193"
Jul 29 10:29:49.208443 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:49.208196    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-44zb2"]
Jul 29 10:29:49.208614 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:49.208558    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:49.208759 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:49.208736    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:49.211133 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:49.211106    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xvrhp"]
Jul 29 10:29:49.211251 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:49.211217    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:49.211332 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:49.211311    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:49.211776 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:49.211756    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-csxgd"]
Jul 29 10:29:49.211879 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:49.211840    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:49.212076 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:49.211932    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:50.558920 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:50.558887    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:50.559453 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:50.559027    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:50.559453 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:50.559082    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:50.559453 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:50.559173    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:51.557189 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:51.557160    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:51.557346 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:51.557273    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvrhp" podUID="b026f57e-f993-4257-8732-63e69c9aaa3c"
Jul 29 10:29:52.557418 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.557379    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:52.557940 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:52.557903    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csxgd" podUID="4f79fb8a-c882-40cf-bffd-6685e5b15c8b"
Jul 29 10:29:52.558013 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.557929    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:52.558070 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:29:52.558054    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-44zb2" podUID="5b84c737-c010-44f8-a233-ad9585234e65"
Jul 29 10:29:52.875005 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.874978    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeReady"
Jul 29 10:29:52.875170 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.875116    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 10:29:52.918864 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.918823    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"]
Jul 29 10:29:52.941893 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.941859    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"]
Jul 29 10:29:52.941893 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.941896    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nvkjd"]
Jul 29 10:29:52.942104 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.941970    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:52.944778 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.944753    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 10:29:52.945093 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.945077    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ms6z2\""
Jul 29 10:29:52.945180 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.945138    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 10:29:52.945180 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.945143    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 10:29:52.951044 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.951025    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 10:29:52.957921 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.957896    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r785v"]
Jul 29 10:29:52.958037 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.958024    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nvkjd"
Jul 29 10:29:52.960858 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.960834    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 10:29:52.960973 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.960930    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 10:29:52.961035 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.961012    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 10:29:52.972048 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.972025    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pbtf2\""
Jul 29 10:29:52.976043 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.976024    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nvkjd"]
Jul 29 10:29:52.976127 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.976056    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r785v"]
Jul 29 10:29:52.976167 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.976159    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r785v"
Jul 29 10:29:52.979292 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.979269    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 10:29:52.979407 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.979299    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 10:29:52.979407 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.979332    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 10:29:52.979407 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.979269    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 10:29:52.979407 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:52.979390    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jl44f\""
Jul 29 10:29:53.005082 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.005050    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67b65fccd5-rfs46"]
Jul 29 10:29:53.024030 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.023996    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67b65fccd5-rfs46"]
Jul 29 10:29:53.024169 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.024097    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:29:53.029036 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.028983    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 10:29:53.029036 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.029006    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 10:29:53.029036 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.028983    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 10:29:53.029364 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.029246    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 10:29:53.029364 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.029317    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 10:29:53.029364 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.029352    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6pjpl\""
Jul 29 10:29:53.029541 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.029449    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 10:29:53.029637 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.029580    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 10:29:53.037644 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.037618    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hgmq9"]
Jul 29 10:29:53.052250 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.052229    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hgmq9"
Jul 29 10:29:53.052922 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.052902    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hgmq9"]
Jul 29 10:29:53.055425 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.055405    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 10:29:53.055547 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.055460    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4pw9d\""
Jul 29 10:29:53.055613 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.055583    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 10:29:53.127000 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.126912    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th29m\" (UniqueName: \"kubernetes.io/projected/0b0078c0-523f-4577-b635-d60eb18c9125-kube-api-access-th29m\") pod \"insights-runtime-extractor-r785v\" (UID: \"0b0078c0-523f-4577-b635-d60eb18c9125\") " pod="openshift-insights/insights-runtime-extractor-r785v"
Jul 29 10:29:53.127000 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.126951    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrgcs\" (UniqueName: \"kubernetes.io/projected/fd4fa30e-5c9b-4216-92b2-95d72a213b77-kube-api-access-hrgcs\") pod \"ingress-canary-nvkjd\" (UID: \"fd4fa30e-5c9b-4216-92b2-95d72a213b77\") " pod="openshift-ingress-canary/ingress-canary-nvkjd"
Jul 29 10:29:53.127000 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.126981    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abbead45-282a-4729-aedd-96fd38a07133-trusted-ca\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.127210 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.127028    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0b0078c0-523f-4577-b635-d60eb18c9125-crio-socket\") pod \"insights-runtime-extractor-r785v\" (UID: \"0b0078c0-523f-4577-b635-d60eb18c9125\") " pod="openshift-insights/insights-runtime-extractor-r785v"
Jul 29 10:29:53.127210 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.127069    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abe394f6-561b-4ffd-95ab-035e92a79ac5-console-serving-cert\") pod \"console-67b65fccd5-rfs46\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") " pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:29:53.127210 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.127101    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/abbead45-282a-4729-aedd-96fd38a07133-ca-trust-extracted\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.127210 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.127130    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/abbead45-282a-4729-aedd-96fd38a07133-registry-certificates\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.127210 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.127149    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abe394f6-561b-4ffd-95ab-035e92a79ac5-service-ca\") pod \"console-67b65fccd5-rfs46\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") " pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:29:53.127210 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.127168    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swf78\" (UniqueName: \"kubernetes.io/projected/abe394f6-561b-4ffd-95ab-035e92a79ac5-kube-api-access-swf78\") pod \"console-67b65fccd5-rfs46\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") " pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:29:53.127384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.127258    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/abbead45-282a-4729-aedd-96fd38a07133-image-registry-private-configuration\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.127384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.127278    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abbead45-282a-4729-aedd-96fd38a07133-registry-tls\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.127384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.127300    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhsk4\" (UniqueName: \"kubernetes.io/projected/abbead45-282a-4729-aedd-96fd38a07133-kube-api-access-lhsk4\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.127384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.127321    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/abbead45-282a-4729-aedd-96fd38a07133-installation-pull-secrets\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.127384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.127339    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b0078c0-523f-4577-b635-d60eb18c9125-data-volume\") pod \"insights-runtime-extractor-r785v\" (UID: \"0b0078c0-523f-4577-b635-d60eb18c9125\") " pod="openshift-insights/insights-runtime-extractor-r785v"
Jul 29 10:29:53.127384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.127380    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b0078c0-523f-4577-b635-d60eb18c9125-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r785v\" (UID: \"0b0078c0-523f-4577-b635-d60eb18c9125\") " pod="openshift-insights/insights-runtime-extractor-r785v"
Jul 29 10:29:53.127553 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.127402    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b0078c0-523f-4577-b635-d60eb18c9125-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r785v\" (UID: \"0b0078c0-523f-4577-b635-d60eb18c9125\") " pod="openshift-insights/insights-runtime-extractor-r785v"
Jul 29 10:29:53.127553 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.127420    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abe394f6-561b-4ffd-95ab-035e92a79ac5-console-oauth-config\") pod \"console-67b65fccd5-rfs46\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") " pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:29:53.127553 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.127436    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abe394f6-561b-4ffd-95ab-035e92a79ac5-oauth-serving-cert\") pod \"console-67b65fccd5-rfs46\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") " pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:29:53.127553 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.127458    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abbead45-282a-4729-aedd-96fd38a07133-bound-sa-token\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.127553 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.127474    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abe394f6-561b-4ffd-95ab-035e92a79ac5-console-config\") pod \"console-67b65fccd5-rfs46\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") " pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:29:53.127553 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.127525    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd4fa30e-5c9b-4216-92b2-95d72a213b77-cert\") pod \"ingress-canary-nvkjd\" (UID: \"fd4fa30e-5c9b-4216-92b2-95d72a213b77\") " pod="openshift-ingress-canary/ingress-canary-nvkjd"
Jul 29 10:29:53.228657 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.228624    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/abbead45-282a-4729-aedd-96fd38a07133-image-registry-private-configuration\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.228782 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.228662    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abbead45-282a-4729-aedd-96fd38a07133-registry-tls\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.228782 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.228681    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhsk4\" (UniqueName: \"kubernetes.io/projected/abbead45-282a-4729-aedd-96fd38a07133-kube-api-access-lhsk4\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.228782 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.228755    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/abbead45-282a-4729-aedd-96fd38a07133-installation-pull-secrets\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.228935 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.228784    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b0078c0-523f-4577-b635-d60eb18c9125-data-volume\") pod \"insights-runtime-extractor-r785v\" (UID: \"0b0078c0-523f-4577-b635-d60eb18c9125\") " pod="openshift-insights/insights-runtime-extractor-r785v"
Jul 29 10:29:53.228935 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.228809    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b0078c0-523f-4577-b635-d60eb18c9125-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r785v\" (UID: \"0b0078c0-523f-4577-b635-d60eb18c9125\") " pod="openshift-insights/insights-runtime-extractor-r785v"
Jul 29 10:29:53.228935 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.228832    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b0078c0-523f-4577-b635-d60eb18c9125-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r785v\" (UID: \"0b0078c0-523f-4577-b635-d60eb18c9125\") " pod="openshift-insights/insights-runtime-extractor-r785v"
Jul 29 10:29:53.228935 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.228856    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abe394f6-561b-4ffd-95ab-035e92a79ac5-console-oauth-config\") pod \"console-67b65fccd5-rfs46\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") " pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:29:53.228935 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.228877    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abe394f6-561b-4ffd-95ab-035e92a79ac5-oauth-serving-cert\") pod \"console-67b65fccd5-rfs46\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") " pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:29:53.228935 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.228905    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abbead45-282a-4729-aedd-96fd38a07133-bound-sa-token\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.228935 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.228927    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abe394f6-561b-4ffd-95ab-035e92a79ac5-console-config\") pod \"console-67b65fccd5-rfs46\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") " pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:29:53.229229 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.228956    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8b9264f-d34e-4992-86ee-d9526253cd51-tmp-dir\") pod \"dns-default-hgmq9\" (UID: \"e8b9264f-d34e-4992-86ee-d9526253cd51\") " pod="openshift-dns/dns-default-hgmq9"
Jul 29 10:29:53.229229 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.229002    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd4fa30e-5c9b-4216-92b2-95d72a213b77-cert\") pod \"ingress-canary-nvkjd\" (UID: \"fd4fa30e-5c9b-4216-92b2-95d72a213b77\") " pod="openshift-ingress-canary/ingress-canary-nvkjd"
Jul 29 10:29:53.229229 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.229024    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdmf8\" (UniqueName: \"kubernetes.io/projected/e8b9264f-d34e-4992-86ee-d9526253cd51-kube-api-access-gdmf8\") pod \"dns-default-hgmq9\" (UID: \"e8b9264f-d34e-4992-86ee-d9526253cd51\") " pod="openshift-dns/dns-default-hgmq9"
Jul 29 10:29:53.229229 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.229048    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th29m\" (UniqueName: \"kubernetes.io/projected/0b0078c0-523f-4577-b635-d60eb18c9125-kube-api-access-th29m\") pod \"insights-runtime-extractor-r785v\" (UID: \"0b0078c0-523f-4577-b635-d60eb18c9125\") " pod="openshift-insights/insights-runtime-extractor-r785v"
Jul 29 10:29:53.229229 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.229070    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrgcs\" (UniqueName: \"kubernetes.io/projected/fd4fa30e-5c9b-4216-92b2-95d72a213b77-kube-api-access-hrgcs\") pod \"ingress-canary-nvkjd\" (UID: \"fd4fa30e-5c9b-4216-92b2-95d72a213b77\") " pod="openshift-ingress-canary/ingress-canary-nvkjd"
Jul 29 10:29:53.229229 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.229094    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e8b9264f-d34e-4992-86ee-d9526253cd51-config-volume\") pod \"dns-default-hgmq9\" (UID: \"e8b9264f-d34e-4992-86ee-d9526253cd51\") " pod="openshift-dns/dns-default-hgmq9"
Jul 29 10:29:53.229229 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.229118    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abbead45-282a-4729-aedd-96fd38a07133-trusted-ca\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.229229 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.229143    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0b0078c0-523f-4577-b635-d60eb18c9125-crio-socket\") pod \"insights-runtime-extractor-r785v\" (UID: \"0b0078c0-523f-4577-b635-d60eb18c9125\") " pod="openshift-insights/insights-runtime-extractor-r785v"
Jul 29 10:29:53.229229 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.229142    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b0078c0-523f-4577-b635-d60eb18c9125-data-volume\") pod \"insights-runtime-extractor-r785v\" (UID: \"0b0078c0-523f-4577-b635-d60eb18c9125\") " pod="openshift-insights/insights-runtime-extractor-r785v"
Jul 29 10:29:53.229229 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.229163    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abe394f6-561b-4ffd-95ab-035e92a79ac5-console-serving-cert\") pod \"console-67b65fccd5-rfs46\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") " pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:29:53.229229 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.229206    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/abbead45-282a-4729-aedd-96fd38a07133-ca-trust-extracted\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.229672 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.229239    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/abbead45-282a-4729-aedd-96fd38a07133-registry-certificates\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.229672 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.229267    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abe394f6-561b-4ffd-95ab-035e92a79ac5-service-ca\") pod \"console-67b65fccd5-rfs46\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") " pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:29:53.229672 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.229290    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swf78\" (UniqueName: \"kubernetes.io/projected/abe394f6-561b-4ffd-95ab-035e92a79ac5-kube-api-access-swf78\") pod \"console-67b65fccd5-rfs46\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") " pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:29:53.229672 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.229337    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8b9264f-d34e-4992-86ee-d9526253cd51-metrics-tls\") pod \"dns-default-hgmq9\" (UID: \"e8b9264f-d34e-4992-86ee-d9526253cd51\") " pod="openshift-dns/dns-default-hgmq9"
Jul 29 10:29:53.229895 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.229874    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/abbead45-282a-4729-aedd-96fd38a07133-ca-trust-extracted\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.230512 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.230484    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abe394f6-561b-4ffd-95ab-035e92a79ac5-service-ca\") pod \"console-67b65fccd5-rfs46\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") " pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:29:53.230621 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.230601    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abe394f6-561b-4ffd-95ab-035e92a79ac5-oauth-serving-cert\") pod \"console-67b65fccd5-rfs46\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") " pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:29:53.231557 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.231195    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/abbead45-282a-4729-aedd-96fd38a07133-registry-certificates\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.231921 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.231699    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abe394f6-561b-4ffd-95ab-035e92a79ac5-console-config\") pod \"console-67b65fccd5-rfs46\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") " pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:29:53.232295 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.232278    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0b0078c0-523f-4577-b635-d60eb18c9125-crio-socket\") pod \"insights-runtime-extractor-r785v\" (UID: \"0b0078c0-523f-4577-b635-d60eb18c9125\") " pod="openshift-insights/insights-runtime-extractor-r785v"
Jul 29 10:29:53.233004 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.232982    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abbead45-282a-4729-aedd-96fd38a07133-trusted-ca\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.233630 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.233611    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abbead45-282a-4729-aedd-96fd38a07133-registry-tls\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.233747 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.233628    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abe394f6-561b-4ffd-95ab-035e92a79ac5-console-oauth-config\") pod \"console-67b65fccd5-rfs46\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") " pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:29:53.233747 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.233699    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/abbead45-282a-4729-aedd-96fd38a07133-installation-pull-secrets\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.233931 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.233909    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b0078c0-523f-4577-b635-d60eb18c9125-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r785v\" (UID: \"0b0078c0-523f-4577-b635-d60eb18c9125\") " pod="openshift-insights/insights-runtime-extractor-r785v"
Jul 29 10:29:53.234084 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.234069    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abe394f6-561b-4ffd-95ab-035e92a79ac5-console-serving-cert\") pod \"console-67b65fccd5-rfs46\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") " pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:29:53.234140 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.234121    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/abbead45-282a-4729-aedd-96fd38a07133-image-registry-private-configuration\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.234810 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.234795    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd4fa30e-5c9b-4216-92b2-95d72a213b77-cert\") pod \"ingress-canary-nvkjd\" (UID: \"fd4fa30e-5c9b-4216-92b2-95d72a213b77\") " pod="openshift-ingress-canary/ingress-canary-nvkjd"
Jul 29 10:29:53.237625 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.237601    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abbead45-282a-4729-aedd-96fd38a07133-bound-sa-token\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.237919 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.237900    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swf78\" (UniqueName: \"kubernetes.io/projected/abe394f6-561b-4ffd-95ab-035e92a79ac5-kube-api-access-swf78\") pod \"console-67b65fccd5-rfs46\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") " pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:29:53.238245 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.238224    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhsk4\" (UniqueName: \"kubernetes.io/projected/abbead45-282a-4729-aedd-96fd38a07133-kube-api-access-lhsk4\") pod \"image-registry-67b5cb5b5b-nqbqn\" (UID: \"abbead45-282a-4729-aedd-96fd38a07133\") " pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.238676 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.238657    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th29m\" (UniqueName: \"kubernetes.io/projected/0b0078c0-523f-4577-b635-d60eb18c9125-kube-api-access-th29m\") pod \"insights-runtime-extractor-r785v\" (UID: \"0b0078c0-523f-4577-b635-d60eb18c9125\") " pod="openshift-insights/insights-runtime-extractor-r785v"
Jul 29 10:29:53.239166 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.239151    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrgcs\" (UniqueName: \"kubernetes.io/projected/fd4fa30e-5c9b-4216-92b2-95d72a213b77-kube-api-access-hrgcs\") pod \"ingress-canary-nvkjd\" (UID: \"fd4fa30e-5c9b-4216-92b2-95d72a213b77\") " pod="openshift-ingress-canary/ingress-canary-nvkjd"
Jul 29 10:29:53.246464 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.246444    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b0078c0-523f-4577-b635-d60eb18c9125-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r785v\" (UID: \"0b0078c0-523f-4577-b635-d60eb18c9125\") " pod="openshift-insights/insights-runtime-extractor-r785v"
Jul 29 10:29:53.253059 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.253036    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.267191 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.267136    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nvkjd"
Jul 29 10:29:53.284331 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.284309    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r785v"
Jul 29 10:29:53.330398 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.330369    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdmf8\" (UniqueName: \"kubernetes.io/projected/e8b9264f-d34e-4992-86ee-d9526253cd51-kube-api-access-gdmf8\") pod \"dns-default-hgmq9\" (UID: \"e8b9264f-d34e-4992-86ee-d9526253cd51\") " pod="openshift-dns/dns-default-hgmq9"
Jul 29 10:29:53.330549 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.330407    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e8b9264f-d34e-4992-86ee-d9526253cd51-config-volume\") pod \"dns-default-hgmq9\" (UID: \"e8b9264f-d34e-4992-86ee-d9526253cd51\") " pod="openshift-dns/dns-default-hgmq9"
Jul 29 10:29:53.330549 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.330459    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8b9264f-d34e-4992-86ee-d9526253cd51-metrics-tls\") pod \"dns-default-hgmq9\" (UID: \"e8b9264f-d34e-4992-86ee-d9526253cd51\") " pod="openshift-dns/dns-default-hgmq9"
Jul 29 10:29:53.330671 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.330563    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8b9264f-d34e-4992-86ee-d9526253cd51-tmp-dir\") pod \"dns-default-hgmq9\" (UID: \"e8b9264f-d34e-4992-86ee-d9526253cd51\") " pod="openshift-dns/dns-default-hgmq9"
Jul 29 10:29:53.330914 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.330877    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8b9264f-d34e-4992-86ee-d9526253cd51-tmp-dir\") pod \"dns-default-hgmq9\" (UID: \"e8b9264f-d34e-4992-86ee-d9526253cd51\") " pod="openshift-dns/dns-default-hgmq9"
Jul 29 10:29:53.331034 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.331006    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e8b9264f-d34e-4992-86ee-d9526253cd51-config-volume\") pod \"dns-default-hgmq9\" (UID: \"e8b9264f-d34e-4992-86ee-d9526253cd51\") " pod="openshift-dns/dns-default-hgmq9"
Jul 29 10:29:53.332929 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.332909    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8b9264f-d34e-4992-86ee-d9526253cd51-metrics-tls\") pod \"dns-default-hgmq9\" (UID: \"e8b9264f-d34e-4992-86ee-d9526253cd51\") " pod="openshift-dns/dns-default-hgmq9"
Jul 29 10:29:53.333789 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.333768    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:29:53.338641 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.338613    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdmf8\" (UniqueName: \"kubernetes.io/projected/e8b9264f-d34e-4992-86ee-d9526253cd51-kube-api-access-gdmf8\") pod \"dns-default-hgmq9\" (UID: \"e8b9264f-d34e-4992-86ee-d9526253cd51\") " pod="openshift-dns/dns-default-hgmq9"
Jul 29 10:29:53.361373 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.361344    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hgmq9"
Jul 29 10:29:53.514000 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.513759    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nvkjd"]
Jul 29 10:29:53.517853 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:53.517806    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd4fa30e_5c9b_4216_92b2_95d72a213b77.slice/crio-8f1e982911ea371b52ab2b3854a52344d94b0492b440428880bf028135410f26 WatchSource:0}: Error finding container 8f1e982911ea371b52ab2b3854a52344d94b0492b440428880bf028135410f26: Status 404 returned error can't find the container with id 8f1e982911ea371b52ab2b3854a52344d94b0492b440428880bf028135410f26
Jul 29 10:29:53.524615 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.524148    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"]
Jul 29 10:29:53.527079 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:53.527040    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabbead45_282a_4729_aedd_96fd38a07133.slice/crio-b0fe53536551319ef14d0f499485e19c50c88096fa91c1e5a67382f0b9ff5e79 WatchSource:0}: Error finding container b0fe53536551319ef14d0f499485e19c50c88096fa91c1e5a67382f0b9ff5e79: Status 404 returned error can't find the container with id b0fe53536551319ef14d0f499485e19c50c88096fa91c1e5a67382f0b9ff5e79
Jul 29 10:29:53.527602 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.527576    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r785v"]
Jul 29 10:29:53.532449 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:53.532413    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b0078c0_523f_4577_b635_d60eb18c9125.slice/crio-0de75951881716e50b12e3fdc2f8e3a87a979d9192400c1ab6c1af7e1249d9da WatchSource:0}: Error finding container 0de75951881716e50b12e3fdc2f8e3a87a979d9192400c1ab6c1af7e1249d9da: Status 404 returned error can't find the container with id 0de75951881716e50b12e3fdc2f8e3a87a979d9192400c1ab6c1af7e1249d9da
Jul 29 10:29:53.556178 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.556149    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67b65fccd5-rfs46"]
Jul 29 10:29:53.557167 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.557151    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:29:53.558965 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:53.558936    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe394f6_561b_4ffd_95ab_035e92a79ac5.slice/crio-4f5a5884dd06d250d96dae0674f9ef26457ee45ec8846ed58daf784947981bc0 WatchSource:0}: Error finding container 4f5a5884dd06d250d96dae0674f9ef26457ee45ec8846ed58daf784947981bc0: Status 404 returned error can't find the container with id 4f5a5884dd06d250d96dae0674f9ef26457ee45ec8846ed58daf784947981bc0
Jul 29 10:29:53.560129 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.560108    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 10:29:53.571667 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.571647    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hgmq9"]
Jul 29 10:29:53.578523 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:29:53.578503    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8b9264f_d34e_4992_86ee_d9526253cd51.slice/crio-6314ce449698f79475b79fe6b29582235988a0e85f13ccf42bfee94ef340ddeb WatchSource:0}: Error finding container 6314ce449698f79475b79fe6b29582235988a0e85f13ccf42bfee94ef340ddeb: Status 404 returned error can't find the container with id 6314ce449698f79475b79fe6b29582235988a0e85f13ccf42bfee94ef340ddeb
Jul 29 10:29:53.778069 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.777991    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b65fccd5-rfs46" event={"ID":"abe394f6-561b-4ffd-95ab-035e92a79ac5","Type":"ContainerStarted","Data":"4f5a5884dd06d250d96dae0674f9ef26457ee45ec8846ed58daf784947981bc0"}
Jul 29 10:29:53.779177 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.779142    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nvkjd" event={"ID":"fd4fa30e-5c9b-4216-92b2-95d72a213b77","Type":"ContainerStarted","Data":"8f1e982911ea371b52ab2b3854a52344d94b0492b440428880bf028135410f26"}
Jul 29 10:29:53.780191 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.780160    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hgmq9" event={"ID":"e8b9264f-d34e-4992-86ee-d9526253cd51","Type":"ContainerStarted","Data":"6314ce449698f79475b79fe6b29582235988a0e85f13ccf42bfee94ef340ddeb"}
Jul 29 10:29:53.781703 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.781680    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn" event={"ID":"abbead45-282a-4729-aedd-96fd38a07133","Type":"ContainerStarted","Data":"344376dac98dddf1ccf09913e1b0a6bad05f0adaec808d81dbd7d6649879227f"}
Jul 29 10:29:53.781823 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.781740    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn" event={"ID":"abbead45-282a-4729-aedd-96fd38a07133","Type":"ContainerStarted","Data":"b0fe53536551319ef14d0f499485e19c50c88096fa91c1e5a67382f0b9ff5e79"}
Jul 29 10:29:53.781823 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.781769    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:29:53.782824 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.782807    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r785v" event={"ID":"0b0078c0-523f-4577-b635-d60eb18c9125","Type":"ContainerStarted","Data":"0de75951881716e50b12e3fdc2f8e3a87a979d9192400c1ab6c1af7e1249d9da"}
Jul 29 10:29:53.804305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:53.804242    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn" podStartSLOduration=6.804225876 podStartE2EDuration="6.804225876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:53.803671577 +0000 UTC m=+43.748910459" watchObservedRunningTime="2026-07-29 10:29:53.804225876 +0000 UTC m=+43.749464721"
Jul 29 10:29:54.560761 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:54.557144    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:29:54.560761 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:54.557590    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:29:54.577731 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:54.573194    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v9npp\""
Jul 29 10:29:54.577731 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:54.573515    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tg7mn\""
Jul 29 10:29:54.577731 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:54.573843    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 10:29:54.577731 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:54.573980    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 10:29:54.577731 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:29:54.573846    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 10:30:02.612803 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.612569    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-57hnh"]
Jul 29 10:30:02.634541 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.634505    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-57hnh"]
Jul 29 10:30:02.634754 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.634659    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-57hnh"
Jul 29 10:30:02.637962 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.637933    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 29 10:30:02.638092 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.637939    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 10:30:02.639396 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.639365    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 29 10:30:02.639519 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.639370    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 10:30:02.639519 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.639414    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 10:30:02.639519 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.639425    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zwk2q\""
Jul 29 10:30:02.707594 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.707550    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64a56dd9-bbe8-48c3-8234-838d8c9275fa-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-57hnh\" (UID: \"64a56dd9-bbe8-48c3-8234-838d8c9275fa\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-57hnh"
Jul 29 10:30:02.707594 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.707598    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64a56dd9-bbe8-48c3-8234-838d8c9275fa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-57hnh\" (UID: \"64a56dd9-bbe8-48c3-8234-838d8c9275fa\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-57hnh"
Jul 29 10:30:02.707841 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.707685    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/64a56dd9-bbe8-48c3-8234-838d8c9275fa-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-57hnh\" (UID: \"64a56dd9-bbe8-48c3-8234-838d8c9275fa\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-57hnh"
Jul 29 10:30:02.707841 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.707803    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8ccs\" (UniqueName: \"kubernetes.io/projected/64a56dd9-bbe8-48c3-8234-838d8c9275fa-kube-api-access-x8ccs\") pod \"prometheus-operator-84d69f794d-57hnh\" (UID: \"64a56dd9-bbe8-48c3-8234-838d8c9275fa\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-57hnh"
Jul 29 10:30:02.809001 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.808959    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8ccs\" (UniqueName: \"kubernetes.io/projected/64a56dd9-bbe8-48c3-8234-838d8c9275fa-kube-api-access-x8ccs\") pod \"prometheus-operator-84d69f794d-57hnh\" (UID: \"64a56dd9-bbe8-48c3-8234-838d8c9275fa\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-57hnh"
Jul 29 10:30:02.809165 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.809011    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64a56dd9-bbe8-48c3-8234-838d8c9275fa-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-57hnh\" (UID: \"64a56dd9-bbe8-48c3-8234-838d8c9275fa\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-57hnh"
Jul 29 10:30:02.809165 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.809131    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64a56dd9-bbe8-48c3-8234-838d8c9275fa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-57hnh\" (UID: \"64a56dd9-bbe8-48c3-8234-838d8c9275fa\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-57hnh"
Jul 29 10:30:02.809246 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.809234    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/64a56dd9-bbe8-48c3-8234-838d8c9275fa-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-57hnh\" (UID: \"64a56dd9-bbe8-48c3-8234-838d8c9275fa\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-57hnh"
Jul 29 10:30:02.809364 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:30:02.809347    2567 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 29 10:30:02.809445 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:30:02.809434    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a56dd9-bbe8-48c3-8234-838d8c9275fa-prometheus-operator-tls podName:64a56dd9-bbe8-48c3-8234-838d8c9275fa nodeName:}" failed. No retries permitted until 2026-07-29 10:30:03.309413856 +0000 UTC m=+53.254652703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/64a56dd9-bbe8-48c3-8234-838d8c9275fa-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-57hnh" (UID: "64a56dd9-bbe8-48c3-8234-838d8c9275fa") : secret "prometheus-operator-tls" not found
Jul 29 10:30:02.809646 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.809630    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64a56dd9-bbe8-48c3-8234-838d8c9275fa-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-57hnh\" (UID: \"64a56dd9-bbe8-48c3-8234-838d8c9275fa\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-57hnh"
Jul 29 10:30:02.813558 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.813535    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64a56dd9-bbe8-48c3-8234-838d8c9275fa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-57hnh\" (UID: \"64a56dd9-bbe8-48c3-8234-838d8c9275fa\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-57hnh"
Jul 29 10:30:02.814808 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.814784    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b65fccd5-rfs46" event={"ID":"abe394f6-561b-4ffd-95ab-035e92a79ac5","Type":"ContainerStarted","Data":"2673cc3a5926b1b27188dd7fa2feb551ea4bc0d6a70cea174423db7113d323df"}
Jul 29 10:30:02.816302 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.816271    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nvkjd" event={"ID":"fd4fa30e-5c9b-4216-92b2-95d72a213b77","Type":"ContainerStarted","Data":"2706ca337fc9b090dbcb7a8ae5c81035be0fb6221478eeef76e3286c7bea66e4"}
Jul 29 10:30:02.817989 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.817960    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hgmq9" event={"ID":"e8b9264f-d34e-4992-86ee-d9526253cd51","Type":"ContainerStarted","Data":"05c61191dd8eccc7bdd99912d6cd8c9b02694e1870f9f2eb0d25b32e853dafc0"}
Jul 29 10:30:02.818114 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.818016    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hgmq9"
Jul 29 10:30:02.818114 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.818043    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hgmq9" event={"ID":"e8b9264f-d34e-4992-86ee-d9526253cd51","Type":"ContainerStarted","Data":"7d61a32ef114c132800bd91b34cdec64fc74fecb516f86fe44c60dd738e6f862"}
Jul 29 10:30:02.819090 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.819066    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8ccs\" (UniqueName: \"kubernetes.io/projected/64a56dd9-bbe8-48c3-8234-838d8c9275fa-kube-api-access-x8ccs\") pod \"prometheus-operator-84d69f794d-57hnh\" (UID: \"64a56dd9-bbe8-48c3-8234-838d8c9275fa\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-57hnh"
Jul 29 10:30:02.819521 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.819504    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r785v" event={"ID":"0b0078c0-523f-4577-b635-d60eb18c9125","Type":"ContainerStarted","Data":"a01d4d4b76cdbe574419bea863c5eaf12d6877b558002c6a3d9727a024c3f3a3"}
Jul 29 10:30:02.833777 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.833699    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67b65fccd5-rfs46" podStartSLOduration=2.316838064 podStartE2EDuration="10.833682094s" totalImagesPullingTime="8.51684403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:02.833055629 +0000 UTC m=+52.778294506" watchObservedRunningTime="2026-07-29 10:30:02.833682094 +0000 UTC m=+52.778920917"
Jul 29 10:30:02.853849 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.853793    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hgmq9" podStartSLOduration=1.356093892 podStartE2EDuration="9.853776861s" totalImagesPullingTime="8.497682969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:02.853494378 +0000 UTC m=+52.798733291" watchObservedRunningTime="2026-07-29 10:30:02.853776861 +0000 UTC m=+52.799015706"
Jul 29 10:30:02.871857 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:02.871803    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nvkjd" podStartSLOduration=2.313859533 podStartE2EDuration="10.871785202s" totalImagesPullingTime="8.557925669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:02.871253888 +0000 UTC m=+52.816492760" watchObservedRunningTime="2026-07-29 10:30:02.871785202 +0000 UTC m=+52.817024047"
Jul 29 10:30:03.313809 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:03.313627    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/64a56dd9-bbe8-48c3-8234-838d8c9275fa-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-57hnh\" (UID: \"64a56dd9-bbe8-48c3-8234-838d8c9275fa\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-57hnh"
Jul 29 10:30:03.316804 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:03.316773    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/64a56dd9-bbe8-48c3-8234-838d8c9275fa-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-57hnh\" (UID: \"64a56dd9-bbe8-48c3-8234-838d8c9275fa\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-57hnh"
Jul 29 10:30:03.334831 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:03.334703    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:30:03.334831 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:03.334828    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:30:03.336039 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:03.336011    2567 patch_prober.go:28] interesting pod/console-67b65fccd5-rfs46 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body=
Jul 29 10:30:03.336156 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:03.336062    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-67b65fccd5-rfs46" podUID="abe394f6-561b-4ffd-95ab-035e92a79ac5" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused"
Jul 29 10:30:03.545310 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:03.545274    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-57hnh"
Jul 29 10:30:03.709516 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:03.709481    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-57hnh"]
Jul 29 10:30:03.714129 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:30:03.714105    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a56dd9_bbe8_48c3_8234_838d8c9275fa.slice/crio-c9996872082c799db0d2a996fa39625b02153fb82f6674f99db210f2a5ac071c WatchSource:0}: Error finding container c9996872082c799db0d2a996fa39625b02153fb82f6674f99db210f2a5ac071c: Status 404 returned error can't find the container with id c9996872082c799db0d2a996fa39625b02153fb82f6674f99db210f2a5ac071c
Jul 29 10:30:03.824651 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:03.824492    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-57hnh" event={"ID":"64a56dd9-bbe8-48c3-8234-838d8c9275fa","Type":"ContainerStarted","Data":"c9996872082c799db0d2a996fa39625b02153fb82f6674f99db210f2a5ac071c"}
Jul 29 10:30:06.836870 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:06.836781    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r785v" event={"ID":"0b0078c0-523f-4577-b635-d60eb18c9125","Type":"ContainerStarted","Data":"fa14be51c63eefaba2690f7d229e81b50cd03dd89f829c5ba40047a46ec6b297"}
Jul 29 10:30:06.838446 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:06.838424    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-57hnh" event={"ID":"64a56dd9-bbe8-48c3-8234-838d8c9275fa","Type":"ContainerStarted","Data":"aebfb3512003334dae36cd33cace24e337a5a8b0cee9dacff9552b1376e237f6"}
Jul 29 10:30:06.838527 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:06.838468    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-57hnh" event={"ID":"64a56dd9-bbe8-48c3-8234-838d8c9275fa","Type":"ContainerStarted","Data":"66c1777da29fafb96e24730ae735c2164b13987005be1e392c6990137128735d"}
Jul 29 10:30:06.859230 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:06.859180    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-57hnh" podStartSLOduration=2.182216869 podStartE2EDuration="4.85916521s" totalImagesPullingTime="2.676948341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:06.858323673 +0000 UTC m=+56.803562520" watchObservedRunningTime="2026-07-29 10:30:06.85916521 +0000 UTC m=+56.804404055"
Jul 29 10:30:09.020367 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.020331    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jwgdz"]
Jul 29 10:30:09.030962 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.030926    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"]
Jul 29 10:30:09.031132 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.031040    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.033265 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.033241    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.034123 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.033978    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 10:30:09.034123 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.033979    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 10:30:09.034123 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.033979    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j9jh4\""
Jul 29 10:30:09.034123 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.033984    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 10:30:09.036514 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.036489    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-p8vk8\""
Jul 29 10:30:09.036905 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.036887    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 29 10:30:09.037079 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.036981    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"]
Jul 29 10:30:09.037253 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.037158    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 29 10:30:09.037253 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.037246    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 29 10:30:09.061169 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.061144    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3f8fe17b-b98f-4d03-9011-ea75a4681751-node-exporter-tls\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.061356 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.061208    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-vthnv\" (UID: \"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.061356 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.061264    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f8fe17b-b98f-4d03-9011-ea75a4681751-sys\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.061356 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.061303    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3f8fe17b-b98f-4d03-9011-ea75a4681751-node-exporter-accelerators-collector-config\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.061531 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.061380    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3f8fe17b-b98f-4d03-9011-ea75a4681751-root\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.061531 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.061416    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f8fe17b-b98f-4d03-9011-ea75a4681751-metrics-client-ca\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.061531 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.061446    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f8fe17b-b98f-4d03-9011-ea75a4681751-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.061531 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.061474    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-vthnv\" (UID: \"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.061666 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.061531    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3f8fe17b-b98f-4d03-9011-ea75a4681751-node-exporter-textfile\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.061666 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.061566    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-vthnv\" (UID: \"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.061666 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.061593    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-vthnv\" (UID: \"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.061666 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.061615    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q77w6\" (UniqueName: \"kubernetes.io/projected/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-kube-api-access-q77w6\") pod \"kube-state-metrics-56d9f944b4-vthnv\" (UID: \"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.061666 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.061639    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3f8fe17b-b98f-4d03-9011-ea75a4681751-node-exporter-wtmp\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.061666 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.061663    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngnd8\" (UniqueName: \"kubernetes.io/projected/3f8fe17b-b98f-4d03-9011-ea75a4681751-kube-api-access-ngnd8\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.061966 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.061776    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-vthnv\" (UID: \"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.163016 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.162970    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-vthnv\" (UID: \"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.163204 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163029    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f8fe17b-b98f-4d03-9011-ea75a4681751-sys\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.163204 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163081    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3f8fe17b-b98f-4d03-9011-ea75a4681751-node-exporter-accelerators-collector-config\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.163204 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163155    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f8fe17b-b98f-4d03-9011-ea75a4681751-sys\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.163380 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163203    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3f8fe17b-b98f-4d03-9011-ea75a4681751-root\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.163380 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163231    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f8fe17b-b98f-4d03-9011-ea75a4681751-metrics-client-ca\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.163380 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163251    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f8fe17b-b98f-4d03-9011-ea75a4681751-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.163380 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163279    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-vthnv\" (UID: \"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.163380 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163295    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3f8fe17b-b98f-4d03-9011-ea75a4681751-root\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.163380 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163357    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-vthnv\" (UID: \"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.163380 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163361    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3f8fe17b-b98f-4d03-9011-ea75a4681751-node-exporter-textfile\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.163742 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163417    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-vthnv\" (UID: \"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.163742 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163447    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-vthnv\" (UID: \"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.163742 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163470    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q77w6\" (UniqueName: \"kubernetes.io/projected/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-kube-api-access-q77w6\") pod \"kube-state-metrics-56d9f944b4-vthnv\" (UID: \"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.163742 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163498    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3f8fe17b-b98f-4d03-9011-ea75a4681751-node-exporter-wtmp\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.163742 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163524    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngnd8\" (UniqueName: \"kubernetes.io/projected/3f8fe17b-b98f-4d03-9011-ea75a4681751-kube-api-access-ngnd8\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.163742 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163555    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-vthnv\" (UID: \"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.163742 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163582    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3f8fe17b-b98f-4d03-9011-ea75a4681751-node-exporter-tls\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.163742 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163655    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3f8fe17b-b98f-4d03-9011-ea75a4681751-node-exporter-textfile\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.163742 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163671    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3f8fe17b-b98f-4d03-9011-ea75a4681751-node-exporter-accelerators-collector-config\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.163742 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:30:09.163732    2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 29 10:30:09.164259 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:30:09.163785    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f8fe17b-b98f-4d03-9011-ea75a4681751-node-exporter-tls podName:3f8fe17b-b98f-4d03-9011-ea75a4681751 nodeName:}" failed. No retries permitted until 2026-07-29 10:30:09.663769383 +0000 UTC m=+59.609008224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3f8fe17b-b98f-4d03-9011-ea75a4681751-node-exporter-tls") pod "node-exporter-jwgdz" (UID: "3f8fe17b-b98f-4d03-9011-ea75a4681751") : secret "node-exporter-tls" not found
Jul 29 10:30:09.164259 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163802    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f8fe17b-b98f-4d03-9011-ea75a4681751-metrics-client-ca\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.164259 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.163972    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-vthnv\" (UID: \"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.164259 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:30:09.164023    2567 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 29 10:30:09.164259 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.164081    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3f8fe17b-b98f-4d03-9011-ea75a4681751-node-exporter-wtmp\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.164259 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:30:09.164086    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-kube-state-metrics-tls podName:311a05aa-f71e-4eb7-8b47-fbdaa44df5cb nodeName:}" failed. No retries permitted until 2026-07-29 10:30:09.664066885 +0000 UTC m=+59.609305719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-vthnv" (UID: "311a05aa-f71e-4eb7-8b47-fbdaa44df5cb") : secret "kube-state-metrics-tls" not found
Jul 29 10:30:09.164582 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.164291    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-vthnv\" (UID: \"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.167210 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.167184    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f8fe17b-b98f-4d03-9011-ea75a4681751-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.167335 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.167319    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-vthnv\" (UID: \"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.176902 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.176876    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q77w6\" (UniqueName: \"kubernetes.io/projected/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-kube-api-access-q77w6\") pod \"kube-state-metrics-56d9f944b4-vthnv\" (UID: \"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.179517 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.179484    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngnd8\" (UniqueName: \"kubernetes.io/projected/3f8fe17b-b98f-4d03-9011-ea75a4681751-kube-api-access-ngnd8\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.668676 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.668641    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-vthnv\" (UID: \"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.668882 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.668707    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3f8fe17b-b98f-4d03-9011-ea75a4681751-node-exporter-tls\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.671260 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.671222    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3f8fe17b-b98f-4d03-9011-ea75a4681751-node-exporter-tls\") pod \"node-exporter-jwgdz\" (UID: \"3f8fe17b-b98f-4d03-9011-ea75a4681751\") " pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.671439 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.671416    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/311a05aa-f71e-4eb7-8b47-fbdaa44df5cb-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-vthnv\" (UID: \"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.943734 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.943644    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jwgdz"
Jul 29 10:30:09.949959 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:09.949932    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"
Jul 29 10:30:09.953665 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:30:09.953640    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f8fe17b_b98f_4d03_9011_ea75a4681751.slice/crio-ec0a4197cccdb054466bc3bb951f2d3fb04709a36906130d82a8c3b2e225800a WatchSource:0}: Error finding container ec0a4197cccdb054466bc3bb951f2d3fb04709a36906130d82a8c3b2e225800a: Status 404 returned error can't find the container with id ec0a4197cccdb054466bc3bb951f2d3fb04709a36906130d82a8c3b2e225800a
Jul 29 10:30:10.086948 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:10.086911    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv"]
Jul 29 10:30:10.090996 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:30:10.090967    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod311a05aa_f71e_4eb7_8b47_fbdaa44df5cb.slice/crio-ebac1cfbe847ae63ebe30b613c7c32d66c21e18f5035e7b22104a12580041ba2 WatchSource:0}: Error finding container ebac1cfbe847ae63ebe30b613c7c32d66c21e18f5035e7b22104a12580041ba2: Status 404 returned error can't find the container with id ebac1cfbe847ae63ebe30b613c7c32d66c21e18f5035e7b22104a12580041ba2
Jul 29 10:30:10.747425 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:10.747395    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-txz46"
Jul 29 10:30:10.856075 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:10.856008    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv" event={"ID":"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb","Type":"ContainerStarted","Data":"ebac1cfbe847ae63ebe30b613c7c32d66c21e18f5035e7b22104a12580041ba2"}
Jul 29 10:30:10.857284 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:10.857260    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jwgdz" event={"ID":"3f8fe17b-b98f-4d03-9011-ea75a4681751","Type":"ContainerStarted","Data":"ec0a4197cccdb054466bc3bb951f2d3fb04709a36906130d82a8c3b2e225800a"}
Jul 29 10:30:10.859193 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:10.859170    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r785v" event={"ID":"0b0078c0-523f-4577-b635-d60eb18c9125","Type":"ContainerStarted","Data":"59f0a1ab9049bc68a132c3e85e49f63eff08152e1f3938e6bde9d163d832d1f8"}
Jul 29 10:30:10.879472 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:10.879416    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r785v" podStartSLOduration=2.711551773 podStartE2EDuration="18.879399844s" totalImagesPullingTime="16.167848071s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:10.878392437 +0000 UTC m=+60.823631306" watchObservedRunningTime="2026-07-29 10:30:10.879399844 +0000 UTC m=+60.824638696"
Jul 29 10:30:11.863607 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:11.863571    2567 generic.go:356] "Generic (PLEG): container finished" podID="3f8fe17b-b98f-4d03-9011-ea75a4681751" containerID="59150ea926dab1066e426ed870e26a2831bd1a9084794a1171d5342d881e69c7" exitCode=0
Jul 29 10:30:11.864096 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:11.863649    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jwgdz" event={"ID":"3f8fe17b-b98f-4d03-9011-ea75a4681751","Type":"ContainerDied","Data":"59150ea926dab1066e426ed870e26a2831bd1a9084794a1171d5342d881e69c7"}
Jul 29 10:30:12.827109 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:12.827078    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hgmq9"
Jul 29 10:30:12.868834 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:12.868802    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv" event={"ID":"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb","Type":"ContainerStarted","Data":"e042632dc392b69dc1bcbda8837eddcde7faa04ba870ed0d0720e6a29b0ccfbe"}
Jul 29 10:30:12.869273 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:12.868864    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv" event={"ID":"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb","Type":"ContainerStarted","Data":"569ba43578edcb4420276d4095ddaca9297523fe69128a4b3dba7a548f85eb71"}
Jul 29 10:30:12.869273 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:12.868892    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv" event={"ID":"311a05aa-f71e-4eb7-8b47-fbdaa44df5cb","Type":"ContainerStarted","Data":"2d5918c981d260ff5ff40dfaa5b5feb9350537d5f8a3d925c79c83599b85075c"}
Jul 29 10:30:12.871231 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:12.871210    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jwgdz" event={"ID":"3f8fe17b-b98f-4d03-9011-ea75a4681751","Type":"ContainerStarted","Data":"90a958c5733ae9b1c5e2653708880b1c6d3f1b4e3aa82ba8f072a044c52ec0ed"}
Jul 29 10:30:12.871343 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:12.871250    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jwgdz" event={"ID":"3f8fe17b-b98f-4d03-9011-ea75a4681751","Type":"ContainerStarted","Data":"735dbf2d2694509211c7eafe4c56b19d3db4cf6c7e97b67a66e3cc2da8635999"}
Jul 29 10:30:12.893074 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:12.892884    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vthnv" podStartSLOduration=2.784299288 podStartE2EDuration="4.892864705s" totalImagesPullingTime="2.108565417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:12.89155804 +0000 UTC m=+62.836796912" watchObservedRunningTime="2026-07-29 10:30:12.892864705 +0000 UTC m=+62.838103553"
Jul 29 10:30:12.914193 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:12.914139    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jwgdz" podStartSLOduration=3.659293694 podStartE2EDuration="4.914123159s" totalImagesPullingTime="1.161922167s" totalInitContainerRuntime="92.907298ms" isStatefulPod=true podCreationTimestamp="2026-07-29 10:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:12.913004325 +0000 UTC m=+62.858243197" watchObservedRunningTime="2026-07-29 10:30:12.914123159 +0000 UTC m=+62.859362004"
Jul 29 10:30:13.236780 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:13.236745    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67b65fccd5-rfs46"]
Jul 29 10:30:13.257621 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:13.257585    2567 patch_prober.go:28] interesting pod/image-registry-67b5cb5b5b-nqbqn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 29 10:30:13.257784 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:13.257632    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn" podUID="abbead45-282a-4729-aedd-96fd38a07133" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 10:30:14.795550 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:14.795520    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67b5cb5b5b-nqbqn"
Jul 29 10:30:15.206806 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.206770    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cd49cf494-zp6f6"]
Jul 29 10:30:15.208870 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.208848    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.217374 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.217351    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 10:30:15.225048 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.225024    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cd49cf494-zp6f6"]
Jul 29 10:30:15.321393 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.321351    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da2c57c0-069f-495c-8472-224e90cb5efa-console-serving-cert\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.321582 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.321432    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da2c57c0-069f-495c-8472-224e90cb5efa-console-oauth-config\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.321582 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.321493    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-console-config\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.321582 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.321516    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-trusted-ca-bundle\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.321582 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.321565    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-oauth-serving-cert\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.321818 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.321592    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6j6v\" (UniqueName: \"kubernetes.io/projected/da2c57c0-069f-495c-8472-224e90cb5efa-kube-api-access-p6j6v\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.321818 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.321618    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-service-ca\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.422700 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.422664    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-oauth-serving-cert\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.422700 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.422706    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6j6v\" (UniqueName: \"kubernetes.io/projected/da2c57c0-069f-495c-8472-224e90cb5efa-kube-api-access-p6j6v\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.422978 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.422757    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-service-ca\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.422978 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.422797    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da2c57c0-069f-495c-8472-224e90cb5efa-console-serving-cert\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.422978 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.422955    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da2c57c0-069f-495c-8472-224e90cb5efa-console-oauth-config\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.423135 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.423016    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-console-config\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.423135 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.423046    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-trusted-ca-bundle\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.423546 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.423522    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-service-ca\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.423645 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.423577    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-oauth-serving-cert\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.423934 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.423915    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-console-config\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.425897 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.424377    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-trusted-ca-bundle\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.425897 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.425774    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da2c57c0-069f-495c-8472-224e90cb5efa-console-oauth-config\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.426491 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.426470    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da2c57c0-069f-495c-8472-224e90cb5efa-console-serving-cert\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.431260 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.431240    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6j6v\" (UniqueName: \"kubernetes.io/projected/da2c57c0-069f-495c-8472-224e90cb5efa-kube-api-access-p6j6v\") pod \"console-cd49cf494-zp6f6\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") " pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.519512 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.519409    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:15.668477 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.668443    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cd49cf494-zp6f6"]
Jul 29 10:30:15.883614 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.883573    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd49cf494-zp6f6" event={"ID":"da2c57c0-069f-495c-8472-224e90cb5efa","Type":"ContainerStarted","Data":"c4b384e6cbe61d57996dd2ad617296bad1984573ad1466949662e93c7223c2b5"}
Jul 29 10:30:15.883983 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:15.883630    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd49cf494-zp6f6" event={"ID":"da2c57c0-069f-495c-8472-224e90cb5efa","Type":"ContainerStarted","Data":"1a8258fab5748581b084a10d5b2c8cd5200e8f9a8d490b5fbc4c9884096c1ddf"}
Jul 29 10:30:16.228807 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.228704    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret\") pod \"global-pull-secret-syncer-xvrhp\" (UID: \"b026f57e-f993-4257-8732-63e69c9aaa3c\") " pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:30:16.231614 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.231595    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 10:30:16.241393 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.241363    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b026f57e-f993-4257-8732-63e69c9aaa3c-original-pull-secret\") pod \"global-pull-secret-syncer-xvrhp\" (UID: \"b026f57e-f993-4257-8732-63e69c9aaa3c\") " pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:30:16.329754 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.329703    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs\") pod \"network-metrics-daemon-csxgd\" (UID: \"4f79fb8a-c882-40cf-bffd-6685e5b15c8b\") " pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:30:16.332808 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.332773    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 10:30:16.343014 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.342993    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f79fb8a-c882-40cf-bffd-6685e5b15c8b-metrics-certs\") pod \"network-metrics-daemon-csxgd\" (UID: \"4f79fb8a-c882-40cf-bffd-6685e5b15c8b\") " pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:30:16.367244 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.367214    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvrhp"
Jul 29 10:30:16.430212 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.430180    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbxxv\" (UniqueName: \"kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv\") pod \"network-check-target-44zb2\" (UID: \"5b84c737-c010-44f8-a233-ad9585234e65\") " pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:30:16.433176 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.433155    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 10:30:16.447388 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.443766    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 10:30:16.453114 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.453087    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbxxv\" (UniqueName: \"kubernetes.io/projected/5b84c737-c010-44f8-a233-ad9585234e65-kube-api-access-sbxxv\") pod \"network-check-target-44zb2\" (UID: \"5b84c737-c010-44f8-a233-ad9585234e65\") " pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:30:16.488878 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.488812    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v9npp\""
Jul 29 10:30:16.496460 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.496439    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:30:16.497013 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.496997    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tg7mn\""
Jul 29 10:30:16.500587 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.500544    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cd49cf494-zp6f6" podStartSLOduration=1.500526818 podStartE2EDuration="1.500526818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:30:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:15.906473105 +0000 UTC m=+65.851711954" watchObservedRunningTime="2026-07-29 10:30:16.500526818 +0000 UTC m=+66.445765643"
Jul 29 10:30:16.500684 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.500672    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xvrhp"]
Jul 29 10:30:16.503671 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:30:16.503647    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb026f57e_f993_4257_8732_63e69c9aaa3c.slice/crio-b4ee0fdc08cd2b65c9f74f218a25b3ea2d45d9625b4a8f7d600aca0d5230bb42 WatchSource:0}: Error finding container b4ee0fdc08cd2b65c9f74f218a25b3ea2d45d9625b4a8f7d600aca0d5230bb42: Status 404 returned error can't find the container with id b4ee0fdc08cd2b65c9f74f218a25b3ea2d45d9625b4a8f7d600aca0d5230bb42
Jul 29 10:30:16.504354 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.504340    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csxgd"
Jul 29 10:30:16.631823 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.631793    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-44zb2"]
Jul 29 10:30:16.635559 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:30:16.635529    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b84c737_c010_44f8_a233_ad9585234e65.slice/crio-83127dd26d0ff149a8aa342512fe88d8c10ff755b7985252bd7978b7a264de20 WatchSource:0}: Error finding container 83127dd26d0ff149a8aa342512fe88d8c10ff755b7985252bd7978b7a264de20: Status 404 returned error can't find the container with id 83127dd26d0ff149a8aa342512fe88d8c10ff755b7985252bd7978b7a264de20
Jul 29 10:30:16.652788 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.652744    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-csxgd"]
Jul 29 10:30:16.654670 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:30:16.654646    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f79fb8a_c882_40cf_bffd_6685e5b15c8b.slice/crio-960d5fe16edd58adfd0f76e9b1de47ecc4a22cc37bfc6fe46610a4efa202d0a3 WatchSource:0}: Error finding container 960d5fe16edd58adfd0f76e9b1de47ecc4a22cc37bfc6fe46610a4efa202d0a3: Status 404 returned error can't find the container with id 960d5fe16edd58adfd0f76e9b1de47ecc4a22cc37bfc6fe46610a4efa202d0a3
Jul 29 10:30:16.888131 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.888092    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-44zb2" event={"ID":"5b84c737-c010-44f8-a233-ad9585234e65","Type":"ContainerStarted","Data":"83127dd26d0ff149a8aa342512fe88d8c10ff755b7985252bd7978b7a264de20"}
Jul 29 10:30:16.889214 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.889192    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-csxgd" event={"ID":"4f79fb8a-c882-40cf-bffd-6685e5b15c8b","Type":"ContainerStarted","Data":"960d5fe16edd58adfd0f76e9b1de47ecc4a22cc37bfc6fe46610a4efa202d0a3"}
Jul 29 10:30:16.890209 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:16.890188    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xvrhp" event={"ID":"b026f57e-f993-4257-8732-63e69c9aaa3c","Type":"ContainerStarted","Data":"b4ee0fdc08cd2b65c9f74f218a25b3ea2d45d9625b4a8f7d600aca0d5230bb42"}
Jul 29 10:30:18.903878 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:18.903839    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-csxgd" event={"ID":"4f79fb8a-c882-40cf-bffd-6685e5b15c8b","Type":"ContainerStarted","Data":"e8c343723b6eddbfe6eec304e0e2b7e5f95b39485714c16d0cba33ed5f5d57a6"}
Jul 29 10:30:18.904351 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:18.903911    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-csxgd" event={"ID":"4f79fb8a-c882-40cf-bffd-6685e5b15c8b","Type":"ContainerStarted","Data":"59923f8db5a20861972b83648db28d603d3d36796b05be0613d6539e64c9db57"}
Jul 29 10:30:18.927650 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:18.927595    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-csxgd" podStartSLOduration=67.629244505 podStartE2EDuration="1m8.927576259s" totalImagesPullingTime="1.298331754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:18.925703606 +0000 UTC m=+68.870942490" watchObservedRunningTime="2026-07-29 10:30:18.927576259 +0000 UTC m=+68.872815106"
Jul 29 10:30:21.918630 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:21.918592    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xvrhp" event={"ID":"b026f57e-f993-4257-8732-63e69c9aaa3c","Type":"ContainerStarted","Data":"1d803138d80a61b00022947d410ea462f31fbc7e9f1fc9de4c240fcaf83b516e"}
Jul 29 10:30:21.920179 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:21.920152    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-44zb2" event={"ID":"5b84c737-c010-44f8-a233-ad9585234e65","Type":"ContainerStarted","Data":"ed9901266e30e69a8f181e85dddfc2d53b76e66025d38f8aa9942f4bc806e1b2"}
Jul 29 10:30:21.920268 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:21.920216    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:30:21.947852 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:21.947799    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xvrhp" podStartSLOduration=67.308090844 podStartE2EDuration="1m11.947783349s" totalImagesPullingTime="4.639692505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:21.94659343 +0000 UTC m=+71.891832306" watchObservedRunningTime="2026-07-29 10:30:21.947783349 +0000 UTC m=+71.893022195"
Jul 29 10:30:21.975848 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:21.975785    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-44zb2" podStartSLOduration=67.471894087 podStartE2EDuration="1m11.975766228s" totalImagesPullingTime="4.503872141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:21.97526675 +0000 UTC m=+71.920505613" watchObservedRunningTime="2026-07-29 10:30:21.975766228 +0000 UTC m=+71.921005077"
Jul 29 10:30:25.520498 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:25.520454    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:25.520914 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:25.520562    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:25.525369 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:25.525346    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:25.935869 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:25.935840    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:30:38.255606 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:38.255463    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67b65fccd5-rfs46" podUID="abe394f6-561b-4ffd-95ab-035e92a79ac5" containerName="console" containerID="cri-o://2673cc3a5926b1b27188dd7fa2feb551ea4bc0d6a70cea174423db7113d323df" gracePeriod=15
Jul 29 10:30:38.981982 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:38.981953    2567 generic.go:356] "Generic (PLEG): container finished" podID="abe394f6-561b-4ffd-95ab-035e92a79ac5" containerID="2673cc3a5926b1b27188dd7fa2feb551ea4bc0d6a70cea174423db7113d323df" exitCode=0
Jul 29 10:30:38.982126 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:38.982022    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b65fccd5-rfs46" event={"ID":"abe394f6-561b-4ffd-95ab-035e92a79ac5","Type":"ContainerDied","Data":"2673cc3a5926b1b27188dd7fa2feb551ea4bc0d6a70cea174423db7113d323df"}
Jul 29 10:30:39.025986 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.025959    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:30:39.122334 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.122293    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swf78\" (UniqueName: \"kubernetes.io/projected/abe394f6-561b-4ffd-95ab-035e92a79ac5-kube-api-access-swf78\") pod \"abe394f6-561b-4ffd-95ab-035e92a79ac5\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") "
Jul 29 10:30:39.122334 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.122333    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abe394f6-561b-4ffd-95ab-035e92a79ac5-oauth-serving-cert\") pod \"abe394f6-561b-4ffd-95ab-035e92a79ac5\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") "
Jul 29 10:30:39.122557 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.122375    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abe394f6-561b-4ffd-95ab-035e92a79ac5-console-serving-cert\") pod \"abe394f6-561b-4ffd-95ab-035e92a79ac5\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") "
Jul 29 10:30:39.122557 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.122399    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abe394f6-561b-4ffd-95ab-035e92a79ac5-service-ca\") pod \"abe394f6-561b-4ffd-95ab-035e92a79ac5\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") "
Jul 29 10:30:39.122557 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.122424    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abe394f6-561b-4ffd-95ab-035e92a79ac5-console-oauth-config\") pod \"abe394f6-561b-4ffd-95ab-035e92a79ac5\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") "
Jul 29 10:30:39.122557 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.122469    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abe394f6-561b-4ffd-95ab-035e92a79ac5-console-config\") pod \"abe394f6-561b-4ffd-95ab-035e92a79ac5\" (UID: \"abe394f6-561b-4ffd-95ab-035e92a79ac5\") "
Jul 29 10:30:39.122880 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.122849    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abe394f6-561b-4ffd-95ab-035e92a79ac5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "abe394f6-561b-4ffd-95ab-035e92a79ac5" (UID: "abe394f6-561b-4ffd-95ab-035e92a79ac5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 10:30:39.123005 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.122928    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abe394f6-561b-4ffd-95ab-035e92a79ac5-service-ca" (OuterVolumeSpecName: "service-ca") pod "abe394f6-561b-4ffd-95ab-035e92a79ac5" (UID: "abe394f6-561b-4ffd-95ab-035e92a79ac5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 10:30:39.123081 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.123012    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abe394f6-561b-4ffd-95ab-035e92a79ac5-console-config" (OuterVolumeSpecName: "console-config") pod "abe394f6-561b-4ffd-95ab-035e92a79ac5" (UID: "abe394f6-561b-4ffd-95ab-035e92a79ac5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 10:30:39.124784 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.124757    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abe394f6-561b-4ffd-95ab-035e92a79ac5-kube-api-access-swf78" (OuterVolumeSpecName: "kube-api-access-swf78") pod "abe394f6-561b-4ffd-95ab-035e92a79ac5" (UID: "abe394f6-561b-4ffd-95ab-035e92a79ac5"). InnerVolumeSpecName "kube-api-access-swf78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 10:30:39.124784 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.124771    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abe394f6-561b-4ffd-95ab-035e92a79ac5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "abe394f6-561b-4ffd-95ab-035e92a79ac5" (UID: "abe394f6-561b-4ffd-95ab-035e92a79ac5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 10:30:39.124916 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.124837    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abe394f6-561b-4ffd-95ab-035e92a79ac5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "abe394f6-561b-4ffd-95ab-035e92a79ac5" (UID: "abe394f6-561b-4ffd-95ab-035e92a79ac5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 10:30:39.223706 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.223624    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swf78\" (UniqueName: \"kubernetes.io/projected/abe394f6-561b-4ffd-95ab-035e92a79ac5-kube-api-access-swf78\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:30:39.223706 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.223651    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abe394f6-561b-4ffd-95ab-035e92a79ac5-oauth-serving-cert\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:30:39.223706 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.223660    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abe394f6-561b-4ffd-95ab-035e92a79ac5-console-serving-cert\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:30:39.223706 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.223669    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abe394f6-561b-4ffd-95ab-035e92a79ac5-service-ca\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:30:39.223706 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.223678    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abe394f6-561b-4ffd-95ab-035e92a79ac5-console-oauth-config\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:30:39.223706 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.223688    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abe394f6-561b-4ffd-95ab-035e92a79ac5-console-config\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:30:39.987233 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.987206    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b65fccd5-rfs46"
Jul 29 10:30:39.987679 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.987202    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b65fccd5-rfs46" event={"ID":"abe394f6-561b-4ffd-95ab-035e92a79ac5","Type":"ContainerDied","Data":"4f5a5884dd06d250d96dae0674f9ef26457ee45ec8846ed58daf784947981bc0"}
Jul 29 10:30:39.987679 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:39.987336    2567 scope.go:117] "RemoveContainer" containerID="2673cc3a5926b1b27188dd7fa2feb551ea4bc0d6a70cea174423db7113d323df"
Jul 29 10:30:40.012019 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:40.011988    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67b65fccd5-rfs46"]
Jul 29 10:30:40.016291 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:40.016268    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67b65fccd5-rfs46"]
Jul 29 10:30:40.560807 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:40.560777    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abe394f6-561b-4ffd-95ab-035e92a79ac5" path="/var/lib/kubelet/pods/abe394f6-561b-4ffd-95ab-035e92a79ac5/volumes"
Jul 29 10:30:52.925146 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:30:52.925107    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-44zb2"
Jul 29 10:31:33.329618 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.329583    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"]
Jul 29 10:31:33.330016 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.329957    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe394f6-561b-4ffd-95ab-035e92a79ac5" containerName="console"
Jul 29 10:31:33.330016 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.329973    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe394f6-561b-4ffd-95ab-035e92a79ac5" containerName="console"
Jul 29 10:31:33.330089 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.330032    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="abe394f6-561b-4ffd-95ab-035e92a79ac5" containerName="console"
Jul 29 10:31:33.332348 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.332326    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.335455 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.335437    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 29 10:31:33.335677 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.335662    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 29 10:31:33.335811 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.335728    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 29 10:31:33.335811 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.335752    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mvdwr\""
Jul 29 10:31:33.335930 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.335820    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 29 10:31:33.336228 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.336214    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 29 10:31:33.341198 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.341179    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 29 10:31:33.348703 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.348675    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"]
Jul 29 10:31:33.405706 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.405676    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4db49e02-808b-4fa0-9efd-d46a8e7ed934-metrics-client-ca\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.405882 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.405730    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4db49e02-808b-4fa0-9efd-d46a8e7ed934-telemeter-client-tls\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.405882 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.405790    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4db49e02-808b-4fa0-9efd-d46a8e7ed934-serving-certs-ca-bundle\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.405882 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.405831    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4db49e02-808b-4fa0-9efd-d46a8e7ed934-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.405882 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.405867    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4db49e02-808b-4fa0-9efd-d46a8e7ed934-federate-client-tls\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.406014 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.405920    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4db49e02-808b-4fa0-9efd-d46a8e7ed934-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.406014 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.405946    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4db49e02-808b-4fa0-9efd-d46a8e7ed934-secret-telemeter-client\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.406014 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.405960    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpzzg\" (UniqueName: \"kubernetes.io/projected/4db49e02-808b-4fa0-9efd-d46a8e7ed934-kube-api-access-lpzzg\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.506693 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.506656    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4db49e02-808b-4fa0-9efd-d46a8e7ed934-telemeter-client-tls\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.506693 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.506698    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4db49e02-808b-4fa0-9efd-d46a8e7ed934-serving-certs-ca-bundle\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.506954 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.506738    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4db49e02-808b-4fa0-9efd-d46a8e7ed934-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.506954 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.506765    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4db49e02-808b-4fa0-9efd-d46a8e7ed934-federate-client-tls\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.506954 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.506792    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4db49e02-808b-4fa0-9efd-d46a8e7ed934-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.506954 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.506812    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4db49e02-808b-4fa0-9efd-d46a8e7ed934-secret-telemeter-client\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.506954 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.506916    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpzzg\" (UniqueName: \"kubernetes.io/projected/4db49e02-808b-4fa0-9efd-d46a8e7ed934-kube-api-access-lpzzg\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.507202 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.506996    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4db49e02-808b-4fa0-9efd-d46a8e7ed934-metrics-client-ca\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.507756 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.507728    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4db49e02-808b-4fa0-9efd-d46a8e7ed934-metrics-client-ca\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.507894 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.507863    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4db49e02-808b-4fa0-9efd-d46a8e7ed934-serving-certs-ca-bundle\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.507957 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.507922    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4db49e02-808b-4fa0-9efd-d46a8e7ed934-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.509319 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.509288    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4db49e02-808b-4fa0-9efd-d46a8e7ed934-federate-client-tls\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.509456 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.509436    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4db49e02-808b-4fa0-9efd-d46a8e7ed934-telemeter-client-tls\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.509512 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.509466    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4db49e02-808b-4fa0-9efd-d46a8e7ed934-secret-telemeter-client\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.509512 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.509439    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4db49e02-808b-4fa0-9efd-d46a8e7ed934-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.515508 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.515487    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpzzg\" (UniqueName: \"kubernetes.io/projected/4db49e02-808b-4fa0-9efd-d46a8e7ed934-kube-api-access-lpzzg\") pod \"telemeter-client-6b7c68d45f-2nq6t\" (UID: \"4db49e02-808b-4fa0-9efd-d46a8e7ed934\") " pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.644975 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.644948    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"
Jul 29 10:31:33.774631 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:33.774606    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t"]
Jul 29 10:31:33.776962 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:31:33.776931    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4db49e02_808b_4fa0_9efd_d46a8e7ed934.slice/crio-8903399324ee969043ed387c5c508aa2006b10821900a66207f7b4a42ca1b54a WatchSource:0}: Error finding container 8903399324ee969043ed387c5c508aa2006b10821900a66207f7b4a42ca1b54a: Status 404 returned error can't find the container with id 8903399324ee969043ed387c5c508aa2006b10821900a66207f7b4a42ca1b54a
Jul 29 10:31:34.172064 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:34.172030    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t" event={"ID":"4db49e02-808b-4fa0-9efd-d46a8e7ed934","Type":"ContainerStarted","Data":"8903399324ee969043ed387c5c508aa2006b10821900a66207f7b4a42ca1b54a"}
Jul 29 10:31:36.179354 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:36.179315    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t" event={"ID":"4db49e02-808b-4fa0-9efd-d46a8e7ed934","Type":"ContainerStarted","Data":"373c9ff9536bde4f09221b30392ad7c8e89ea8c98176067ac9ab10b89aa39526"}
Jul 29 10:31:37.185184 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:37.185154    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t" event={"ID":"4db49e02-808b-4fa0-9efd-d46a8e7ed934","Type":"ContainerStarted","Data":"5da14242170a3750d8eabf7d8077ebb57a9f5e4d0d49dda06a10da97b80b96ae"}
Jul 29 10:31:37.185652 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:37.185214    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t" event={"ID":"4db49e02-808b-4fa0-9efd-d46a8e7ed934","Type":"ContainerStarted","Data":"2f63662c673e10d2d69136d34dcbe9cc99125ebc12c2e1da1125fd4f25f9f1ce"}
Jul 29 10:31:37.214682 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:37.214627    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6b7c68d45f-2nq6t" podStartSLOduration=1.242254001 podStartE2EDuration="4.214609776s" totalImagesPullingTime="2.972355775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:31:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:31:37.213273124 +0000 UTC m=+147.158511970" watchObservedRunningTime="2026-07-29 10:31:37.214609776 +0000 UTC m=+147.159848621"
Jul 29 10:31:38.367876 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.367845    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65948bbdc-qgdxg"]
Jul 29 10:31:38.369889 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.369874    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.380851 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.380826    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65948bbdc-qgdxg"]
Jul 29 10:31:38.451655 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.451617    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-console-config\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.451655 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.451662    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-oauth-serving-cert\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.451907 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.451683    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl68r\" (UniqueName: \"kubernetes.io/projected/6f1125df-d5b3-4650-b28e-716760d41ff3-kube-api-access-pl68r\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.451907 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.451752    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f1125df-d5b3-4650-b28e-716760d41ff3-console-oauth-config\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.451907 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.451821    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-trusted-ca-bundle\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.451907 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.451836    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f1125df-d5b3-4650-b28e-716760d41ff3-console-serving-cert\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.451907 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.451855    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-service-ca\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.552993 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.552957    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-trusted-ca-bundle\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.553096 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.552996    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f1125df-d5b3-4650-b28e-716760d41ff3-console-serving-cert\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.553096 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.553014    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-service-ca\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.553096 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.553056    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-console-config\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.553096 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.553093    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-oauth-serving-cert\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.553294 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.553122    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl68r\" (UniqueName: \"kubernetes.io/projected/6f1125df-d5b3-4650-b28e-716760d41ff3-kube-api-access-pl68r\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.553294 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.553149    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f1125df-d5b3-4650-b28e-716760d41ff3-console-oauth-config\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.553842 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.553816    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-oauth-serving-cert\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.553842 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.553828    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-service-ca\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.554032 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.553924    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-console-config\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.554092 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.554030    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-trusted-ca-bundle\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.555653 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.555627    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f1125df-d5b3-4650-b28e-716760d41ff3-console-serving-cert\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.555754 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.555627    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f1125df-d5b3-4650-b28e-716760d41ff3-console-oauth-config\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.562646 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.562622    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl68r\" (UniqueName: \"kubernetes.io/projected/6f1125df-d5b3-4650-b28e-716760d41ff3-kube-api-access-pl68r\") pod \"console-65948bbdc-qgdxg\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") " pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.678649 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.678557    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:38.809154 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:38.809125    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65948bbdc-qgdxg"]
Jul 29 10:31:38.812433 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:31:38.812394    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1125df_d5b3_4650_b28e_716760d41ff3.slice/crio-4745eb57c2feb0c71eda83028a9f5e04cd3f880a81d024f9103c70f229054489 WatchSource:0}: Error finding container 4745eb57c2feb0c71eda83028a9f5e04cd3f880a81d024f9103c70f229054489: Status 404 returned error can't find the container with id 4745eb57c2feb0c71eda83028a9f5e04cd3f880a81d024f9103c70f229054489
Jul 29 10:31:39.194413 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:39.194378    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65948bbdc-qgdxg" event={"ID":"6f1125df-d5b3-4650-b28e-716760d41ff3","Type":"ContainerStarted","Data":"bbd9123216e1199cb390b5d9d44afe43b148f9b252a2f61345f5e671f532b9e9"}
Jul 29 10:31:39.194614 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:39.194430    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65948bbdc-qgdxg" event={"ID":"6f1125df-d5b3-4650-b28e-716760d41ff3","Type":"ContainerStarted","Data":"4745eb57c2feb0c71eda83028a9f5e04cd3f880a81d024f9103c70f229054489"}
Jul 29 10:31:39.214759 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:39.214689    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65948bbdc-qgdxg" podStartSLOduration=1.214672562 podStartE2EDuration="1.214672562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:31:39.214208112 +0000 UTC m=+149.159446959" watchObservedRunningTime="2026-07-29 10:31:39.214672562 +0000 UTC m=+149.159911407"
Jul 29 10:31:43.658765 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.658727    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65948bbdc-qgdxg"]
Jul 29 10:31:43.694555 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.694525    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f77d85c6d-dj2mn"]
Jul 29 10:31:43.696867 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.696850    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.708770 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.708749    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f77d85c6d-dj2mn"]
Jul 29 10:31:43.800459 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.800411    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a002ac10-3d81-42b9-91a3-177e29499cb0-console-serving-cert\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.800459 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.800455    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a002ac10-3d81-42b9-91a3-177e29499cb0-console-config\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.800663 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.800472    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56mgc\" (UniqueName: \"kubernetes.io/projected/a002ac10-3d81-42b9-91a3-177e29499cb0-kube-api-access-56mgc\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.800663 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.800544    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a002ac10-3d81-42b9-91a3-177e29499cb0-trusted-ca-bundle\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.800663 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.800577    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a002ac10-3d81-42b9-91a3-177e29499cb0-console-oauth-config\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.800663 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.800614    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a002ac10-3d81-42b9-91a3-177e29499cb0-oauth-serving-cert\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.800663 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.800660    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a002ac10-3d81-42b9-91a3-177e29499cb0-service-ca\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.901705 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.901670    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a002ac10-3d81-42b9-91a3-177e29499cb0-oauth-serving-cert\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.901868 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.901733    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a002ac10-3d81-42b9-91a3-177e29499cb0-service-ca\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.901868 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.901764    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a002ac10-3d81-42b9-91a3-177e29499cb0-console-serving-cert\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.901868 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.901779    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a002ac10-3d81-42b9-91a3-177e29499cb0-console-config\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.901868 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.901793    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56mgc\" (UniqueName: \"kubernetes.io/projected/a002ac10-3d81-42b9-91a3-177e29499cb0-kube-api-access-56mgc\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.901868 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.901816    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a002ac10-3d81-42b9-91a3-177e29499cb0-trusted-ca-bundle\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.901868 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.901855    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a002ac10-3d81-42b9-91a3-177e29499cb0-console-oauth-config\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.902575 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.902520    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a002ac10-3d81-42b9-91a3-177e29499cb0-service-ca\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.902734 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.902668    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a002ac10-3d81-42b9-91a3-177e29499cb0-console-config\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.902819 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.902751    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a002ac10-3d81-42b9-91a3-177e29499cb0-oauth-serving-cert\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.902879 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.902863    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a002ac10-3d81-42b9-91a3-177e29499cb0-trusted-ca-bundle\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.904358 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.904334    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a002ac10-3d81-42b9-91a3-177e29499cb0-console-oauth-config\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.904461 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.904344    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a002ac10-3d81-42b9-91a3-177e29499cb0-console-serving-cert\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:43.910278 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:43.910231    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56mgc\" (UniqueName: \"kubernetes.io/projected/a002ac10-3d81-42b9-91a3-177e29499cb0-kube-api-access-56mgc\") pod \"console-7f77d85c6d-dj2mn\" (UID: \"a002ac10-3d81-42b9-91a3-177e29499cb0\") " pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:44.006028 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:44.005991    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:44.131754 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:44.131706    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f77d85c6d-dj2mn"]
Jul 29 10:31:44.134655 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:31:44.134628    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda002ac10_3d81_42b9_91a3_177e29499cb0.slice/crio-5c50cfd248a33c4c08145f34179544b88690cc702ec7bbe49e449c2c32f6801d WatchSource:0}: Error finding container 5c50cfd248a33c4c08145f34179544b88690cc702ec7bbe49e449c2c32f6801d: Status 404 returned error can't find the container with id 5c50cfd248a33c4c08145f34179544b88690cc702ec7bbe49e449c2c32f6801d
Jul 29 10:31:44.213143 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:44.213112    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f77d85c6d-dj2mn" event={"ID":"a002ac10-3d81-42b9-91a3-177e29499cb0","Type":"ContainerStarted","Data":"4b088ba8109d9e62e57041dbc98b978f2b091e1a8b0fe93b66f5a01a0872349a"}
Jul 29 10:31:44.213299 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:44.213165    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f77d85c6d-dj2mn" event={"ID":"a002ac10-3d81-42b9-91a3-177e29499cb0","Type":"ContainerStarted","Data":"5c50cfd248a33c4c08145f34179544b88690cc702ec7bbe49e449c2c32f6801d"}
Jul 29 10:31:44.233020 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:44.232667    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f77d85c6d-dj2mn" podStartSLOduration=1.232643718 podStartE2EDuration="1.232643718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:31:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:31:44.23122793 +0000 UTC m=+154.176466813" watchObservedRunningTime="2026-07-29 10:31:44.232643718 +0000 UTC m=+154.177882564"
Jul 29 10:31:48.678810 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:48.678772    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:31:54.007150 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:54.007109    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:54.007557 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:54.007196    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:54.011662 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:54.011639    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:54.253046 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:54.253022    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f77d85c6d-dj2mn"
Jul 29 10:31:54.303396 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:31:54.303314    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cd49cf494-zp6f6"]
Jul 29 10:32:08.677157 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:08.677067    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65948bbdc-qgdxg" podUID="6f1125df-d5b3-4650-b28e-716760d41ff3" containerName="console" containerID="cri-o://bbd9123216e1199cb390b5d9d44afe43b148f9b252a2f61345f5e671f532b9e9" gracePeriod=15
Jul 29 10:32:08.916043 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:08.916022    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:32:09.000525 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.000444    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f1125df-d5b3-4650-b28e-716760d41ff3-console-oauth-config\") pod \"6f1125df-d5b3-4650-b28e-716760d41ff3\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") "
Jul 29 10:32:09.000525 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.000482    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f1125df-d5b3-4650-b28e-716760d41ff3-console-serving-cert\") pod \"6f1125df-d5b3-4650-b28e-716760d41ff3\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") "
Jul 29 10:32:09.000525 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.000511    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-oauth-serving-cert\") pod \"6f1125df-d5b3-4650-b28e-716760d41ff3\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") "
Jul 29 10:32:09.000774 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.000534    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-console-config\") pod \"6f1125df-d5b3-4650-b28e-716760d41ff3\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") "
Jul 29 10:32:09.000774 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.000696    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-trusted-ca-bundle\") pod \"6f1125df-d5b3-4650-b28e-716760d41ff3\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") "
Jul 29 10:32:09.000876 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.000771    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pl68r\" (UniqueName: \"kubernetes.io/projected/6f1125df-d5b3-4650-b28e-716760d41ff3-kube-api-access-pl68r\") pod \"6f1125df-d5b3-4650-b28e-716760d41ff3\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") "
Jul 29 10:32:09.000876 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.000812    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-service-ca\") pod \"6f1125df-d5b3-4650-b28e-716760d41ff3\" (UID: \"6f1125df-d5b3-4650-b28e-716760d41ff3\") "
Jul 29 10:32:09.001014 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.000932    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-console-config" (OuterVolumeSpecName: "console-config") pod "6f1125df-d5b3-4650-b28e-716760d41ff3" (UID: "6f1125df-d5b3-4650-b28e-716760d41ff3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 10:32:09.001014 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.000932    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6f1125df-d5b3-4650-b28e-716760d41ff3" (UID: "6f1125df-d5b3-4650-b28e-716760d41ff3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 10:32:09.001153 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.001062    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-oauth-serving-cert\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:32:09.001153 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.001080    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-console-config\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:32:09.001242 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.001199    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6f1125df-d5b3-4650-b28e-716760d41ff3" (UID: "6f1125df-d5b3-4650-b28e-716760d41ff3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 10:32:09.001287 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.001271    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-service-ca" (OuterVolumeSpecName: "service-ca") pod "6f1125df-d5b3-4650-b28e-716760d41ff3" (UID: "6f1125df-d5b3-4650-b28e-716760d41ff3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 10:32:09.002574 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.002553    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f1125df-d5b3-4650-b28e-716760d41ff3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6f1125df-d5b3-4650-b28e-716760d41ff3" (UID: "6f1125df-d5b3-4650-b28e-716760d41ff3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 10:32:09.003025 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.003005    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f1125df-d5b3-4650-b28e-716760d41ff3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6f1125df-d5b3-4650-b28e-716760d41ff3" (UID: "6f1125df-d5b3-4650-b28e-716760d41ff3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 10:32:09.003075 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.003022    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f1125df-d5b3-4650-b28e-716760d41ff3-kube-api-access-pl68r" (OuterVolumeSpecName: "kube-api-access-pl68r") pod "6f1125df-d5b3-4650-b28e-716760d41ff3" (UID: "6f1125df-d5b3-4650-b28e-716760d41ff3"). InnerVolumeSpecName "kube-api-access-pl68r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 10:32:09.102392 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.102359    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl68r\" (UniqueName: \"kubernetes.io/projected/6f1125df-d5b3-4650-b28e-716760d41ff3-kube-api-access-pl68r\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:32:09.102392 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.102387    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-service-ca\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:32:09.102392 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.102397    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f1125df-d5b3-4650-b28e-716760d41ff3-console-oauth-config\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:32:09.102599 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.102406    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f1125df-d5b3-4650-b28e-716760d41ff3-console-serving-cert\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:32:09.102599 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.102414    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f1125df-d5b3-4650-b28e-716760d41ff3-trusted-ca-bundle\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:32:09.303742 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.303655    2567 generic.go:356] "Generic (PLEG): container finished" podID="6f1125df-d5b3-4650-b28e-716760d41ff3" containerID="bbd9123216e1199cb390b5d9d44afe43b148f9b252a2f61345f5e671f532b9e9" exitCode=0
Jul 29 10:32:09.303742 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.303695    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65948bbdc-qgdxg" event={"ID":"6f1125df-d5b3-4650-b28e-716760d41ff3","Type":"ContainerDied","Data":"bbd9123216e1199cb390b5d9d44afe43b148f9b252a2f61345f5e671f532b9e9"}
Jul 29 10:32:09.303742 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.303700    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65948bbdc-qgdxg"
Jul 29 10:32:09.304032 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.303757    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65948bbdc-qgdxg" event={"ID":"6f1125df-d5b3-4650-b28e-716760d41ff3","Type":"ContainerDied","Data":"4745eb57c2feb0c71eda83028a9f5e04cd3f880a81d024f9103c70f229054489"}
Jul 29 10:32:09.304032 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.303779    2567 scope.go:117] "RemoveContainer" containerID="bbd9123216e1199cb390b5d9d44afe43b148f9b252a2f61345f5e671f532b9e9"
Jul 29 10:32:09.319987 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.319875    2567 scope.go:117] "RemoveContainer" containerID="bbd9123216e1199cb390b5d9d44afe43b148f9b252a2f61345f5e671f532b9e9"
Jul 29 10:32:09.320523 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:32:09.320496    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbd9123216e1199cb390b5d9d44afe43b148f9b252a2f61345f5e671f532b9e9\": container with ID starting with bbd9123216e1199cb390b5d9d44afe43b148f9b252a2f61345f5e671f532b9e9 not found: ID does not exist" containerID="bbd9123216e1199cb390b5d9d44afe43b148f9b252a2f61345f5e671f532b9e9"
Jul 29 10:32:09.320604 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.320534    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbd9123216e1199cb390b5d9d44afe43b148f9b252a2f61345f5e671f532b9e9"} err="failed to get container status \"bbd9123216e1199cb390b5d9d44afe43b148f9b252a2f61345f5e671f532b9e9\": rpc error: code = NotFound desc = could not find container \"bbd9123216e1199cb390b5d9d44afe43b148f9b252a2f61345f5e671f532b9e9\": container with ID starting with bbd9123216e1199cb390b5d9d44afe43b148f9b252a2f61345f5e671f532b9e9 not found: ID does not exist"
Jul 29 10:32:09.331139 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.331108    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65948bbdc-qgdxg"]
Jul 29 10:32:09.336789 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:09.336761    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65948bbdc-qgdxg"]
Jul 29 10:32:10.561453 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:10.561417    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f1125df-d5b3-4650-b28e-716760d41ff3" path="/var/lib/kubelet/pods/6f1125df-d5b3-4650-b28e-716760d41ff3/volumes"
Jul 29 10:32:19.323899 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.323839    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cd49cf494-zp6f6" podUID="da2c57c0-069f-495c-8472-224e90cb5efa" containerName="console" containerID="cri-o://c4b384e6cbe61d57996dd2ad617296bad1984573ad1466949662e93c7223c2b5" gracePeriod=15
Jul 29 10:32:19.567301 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.567279    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:32:19.682738 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.682661    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da2c57c0-069f-495c-8472-224e90cb5efa-console-oauth-config\") pod \"da2c57c0-069f-495c-8472-224e90cb5efa\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") "
Jul 29 10:32:19.682738 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.682741    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-service-ca\") pod \"da2c57c0-069f-495c-8472-224e90cb5efa\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") "
Jul 29 10:32:19.682947 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.682767    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da2c57c0-069f-495c-8472-224e90cb5efa-console-serving-cert\") pod \"da2c57c0-069f-495c-8472-224e90cb5efa\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") "
Jul 29 10:32:19.682947 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.682867    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-oauth-serving-cert\") pod \"da2c57c0-069f-495c-8472-224e90cb5efa\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") "
Jul 29 10:32:19.683021 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.682967    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-trusted-ca-bundle\") pod \"da2c57c0-069f-495c-8472-224e90cb5efa\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") "
Jul 29 10:32:19.683021 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.682997    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6j6v\" (UniqueName: \"kubernetes.io/projected/da2c57c0-069f-495c-8472-224e90cb5efa-kube-api-access-p6j6v\") pod \"da2c57c0-069f-495c-8472-224e90cb5efa\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") "
Jul 29 10:32:19.683116 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.683042    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-console-config\") pod \"da2c57c0-069f-495c-8472-224e90cb5efa\" (UID: \"da2c57c0-069f-495c-8472-224e90cb5efa\") "
Jul 29 10:32:19.683174 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.683137    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-service-ca" (OuterVolumeSpecName: "service-ca") pod "da2c57c0-069f-495c-8472-224e90cb5efa" (UID: "da2c57c0-069f-495c-8472-224e90cb5efa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 10:32:19.683290 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.683259    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-service-ca\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:32:19.683436 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.683302    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "da2c57c0-069f-495c-8472-224e90cb5efa" (UID: "da2c57c0-069f-495c-8472-224e90cb5efa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 10:32:19.683436 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.683389    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "da2c57c0-069f-495c-8472-224e90cb5efa" (UID: "da2c57c0-069f-495c-8472-224e90cb5efa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 10:32:19.683560 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.683500    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-console-config" (OuterVolumeSpecName: "console-config") pod "da2c57c0-069f-495c-8472-224e90cb5efa" (UID: "da2c57c0-069f-495c-8472-224e90cb5efa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 10:32:19.685011 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.684988    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da2c57c0-069f-495c-8472-224e90cb5efa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "da2c57c0-069f-495c-8472-224e90cb5efa" (UID: "da2c57c0-069f-495c-8472-224e90cb5efa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 10:32:19.685090 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.685032    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da2c57c0-069f-495c-8472-224e90cb5efa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "da2c57c0-069f-495c-8472-224e90cb5efa" (UID: "da2c57c0-069f-495c-8472-224e90cb5efa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 10:32:19.685090 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.685042    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da2c57c0-069f-495c-8472-224e90cb5efa-kube-api-access-p6j6v" (OuterVolumeSpecName: "kube-api-access-p6j6v") pod "da2c57c0-069f-495c-8472-224e90cb5efa" (UID: "da2c57c0-069f-495c-8472-224e90cb5efa"). InnerVolumeSpecName "kube-api-access-p6j6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 10:32:19.784497 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.784459    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da2c57c0-069f-495c-8472-224e90cb5efa-console-oauth-config\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:32:19.784497 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.784489    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da2c57c0-069f-495c-8472-224e90cb5efa-console-serving-cert\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:32:19.784497 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.784499    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-oauth-serving-cert\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:32:19.784735 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.784508    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-trusted-ca-bundle\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:32:19.784735 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.784516    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6j6v\" (UniqueName: \"kubernetes.io/projected/da2c57c0-069f-495c-8472-224e90cb5efa-kube-api-access-p6j6v\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:32:19.784735 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:19.784525    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da2c57c0-069f-495c-8472-224e90cb5efa-console-config\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:32:20.341404 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:20.341366    2567 generic.go:356] "Generic (PLEG): container finished" podID="da2c57c0-069f-495c-8472-224e90cb5efa" containerID="c4b384e6cbe61d57996dd2ad617296bad1984573ad1466949662e93c7223c2b5" exitCode=0
Jul 29 10:32:20.341864 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:20.341414    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd49cf494-zp6f6"
Jul 29 10:32:20.341864 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:20.341431    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd49cf494-zp6f6" event={"ID":"da2c57c0-069f-495c-8472-224e90cb5efa","Type":"ContainerDied","Data":"c4b384e6cbe61d57996dd2ad617296bad1984573ad1466949662e93c7223c2b5"}
Jul 29 10:32:20.341864 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:20.341472    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd49cf494-zp6f6" event={"ID":"da2c57c0-069f-495c-8472-224e90cb5efa","Type":"ContainerDied","Data":"1a8258fab5748581b084a10d5b2c8cd5200e8f9a8d490b5fbc4c9884096c1ddf"}
Jul 29 10:32:20.341864 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:20.341491    2567 scope.go:117] "RemoveContainer" containerID="c4b384e6cbe61d57996dd2ad617296bad1984573ad1466949662e93c7223c2b5"
Jul 29 10:32:20.349567 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:20.349549    2567 scope.go:117] "RemoveContainer" containerID="c4b384e6cbe61d57996dd2ad617296bad1984573ad1466949662e93c7223c2b5"
Jul 29 10:32:20.349858 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:32:20.349839    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4b384e6cbe61d57996dd2ad617296bad1984573ad1466949662e93c7223c2b5\": container with ID starting with c4b384e6cbe61d57996dd2ad617296bad1984573ad1466949662e93c7223c2b5 not found: ID does not exist" containerID="c4b384e6cbe61d57996dd2ad617296bad1984573ad1466949662e93c7223c2b5"
Jul 29 10:32:20.349933 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:20.349870    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4b384e6cbe61d57996dd2ad617296bad1984573ad1466949662e93c7223c2b5"} err="failed to get container status \"c4b384e6cbe61d57996dd2ad617296bad1984573ad1466949662e93c7223c2b5\": rpc error: code = NotFound desc = could not find container \"c4b384e6cbe61d57996dd2ad617296bad1984573ad1466949662e93c7223c2b5\": container with ID starting with c4b384e6cbe61d57996dd2ad617296bad1984573ad1466949662e93c7223c2b5 not found: ID does not exist"
Jul 29 10:32:20.362840 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:20.362816    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cd49cf494-zp6f6"]
Jul 29 10:32:20.366454 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:20.366432    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cd49cf494-zp6f6"]
Jul 29 10:32:20.565600 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:32:20.565554    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da2c57c0-069f-495c-8472-224e90cb5efa" path="/var/lib/kubelet/pods/da2c57c0-069f-495c-8472-224e90cb5efa/volumes"
Jul 29 10:34:10.399823 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:10.399793    2567 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 10:34:24.203144 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.203110    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm"]
Jul 29 10:34:24.205445 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.203345    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da2c57c0-069f-495c-8472-224e90cb5efa" containerName="console"
Jul 29 10:34:24.205445 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.203356    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="da2c57c0-069f-495c-8472-224e90cb5efa" containerName="console"
Jul 29 10:34:24.205445 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.203381    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f1125df-d5b3-4650-b28e-716760d41ff3" containerName="console"
Jul 29 10:34:24.205445 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.203387    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f1125df-d5b3-4650-b28e-716760d41ff3" containerName="console"
Jul 29 10:34:24.205445 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.203430    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f1125df-d5b3-4650-b28e-716760d41ff3" containerName="console"
Jul 29 10:34:24.205445 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.203440    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="da2c57c0-069f-495c-8472-224e90cb5efa" containerName="console"
Jul 29 10:34:24.206292 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.206278    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm"
Jul 29 10:34:24.209010 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.208991    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 10:34:24.209248 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.209233    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 10:34:24.210496 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.210480    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cvwvg\""
Jul 29 10:34:24.222575 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.222553    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm"]
Jul 29 10:34:24.258279 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.258257    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a9924be-5124-4322-b7ef-3bf27c821f25-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm\" (UID: \"9a9924be-5124-4322-b7ef-3bf27c821f25\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm"
Jul 29 10:34:24.258397 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.258286    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xcsz\" (UniqueName: \"kubernetes.io/projected/9a9924be-5124-4322-b7ef-3bf27c821f25-kube-api-access-6xcsz\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm\" (UID: \"9a9924be-5124-4322-b7ef-3bf27c821f25\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm"
Jul 29 10:34:24.258397 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.258316    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a9924be-5124-4322-b7ef-3bf27c821f25-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm\" (UID: \"9a9924be-5124-4322-b7ef-3bf27c821f25\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm"
Jul 29 10:34:24.359227 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.359193    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a9924be-5124-4322-b7ef-3bf27c821f25-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm\" (UID: \"9a9924be-5124-4322-b7ef-3bf27c821f25\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm"
Jul 29 10:34:24.359227 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.359228    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xcsz\" (UniqueName: \"kubernetes.io/projected/9a9924be-5124-4322-b7ef-3bf27c821f25-kube-api-access-6xcsz\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm\" (UID: \"9a9924be-5124-4322-b7ef-3bf27c821f25\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm"
Jul 29 10:34:24.359423 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.359257    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a9924be-5124-4322-b7ef-3bf27c821f25-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm\" (UID: \"9a9924be-5124-4322-b7ef-3bf27c821f25\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm"
Jul 29 10:34:24.359597 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.359568    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a9924be-5124-4322-b7ef-3bf27c821f25-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm\" (UID: \"9a9924be-5124-4322-b7ef-3bf27c821f25\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm"
Jul 29 10:34:24.359634 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.359620    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a9924be-5124-4322-b7ef-3bf27c821f25-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm\" (UID: \"9a9924be-5124-4322-b7ef-3bf27c821f25\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm"
Jul 29 10:34:24.368153 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.368127    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xcsz\" (UniqueName: \"kubernetes.io/projected/9a9924be-5124-4322-b7ef-3bf27c821f25-kube-api-access-6xcsz\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm\" (UID: \"9a9924be-5124-4322-b7ef-3bf27c821f25\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm"
Jul 29 10:34:24.515319 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.515239    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm"
Jul 29 10:34:24.646314 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.646181    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm"]
Jul 29 10:34:24.648817 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:34:24.648786    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9924be_5124_4322_b7ef_3bf27c821f25.slice/crio-f0915686ff2b116d33f93920e85c2ab2288f83fc789edec74a41dbac1b142701 WatchSource:0}: Error finding container f0915686ff2b116d33f93920e85c2ab2288f83fc789edec74a41dbac1b142701: Status 404 returned error can't find the container with id f0915686ff2b116d33f93920e85c2ab2288f83fc789edec74a41dbac1b142701
Jul 29 10:34:24.650703 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.650690    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 10:34:24.759842 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:24.759810    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm" event={"ID":"9a9924be-5124-4322-b7ef-3bf27c821f25","Type":"ContainerStarted","Data":"f0915686ff2b116d33f93920e85c2ab2288f83fc789edec74a41dbac1b142701"}
Jul 29 10:34:31.785636 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:31.785601    2567 generic.go:356] "Generic (PLEG): container finished" podID="9a9924be-5124-4322-b7ef-3bf27c821f25" containerID="b75c3dedbf82fc5985b82ce6667c9ebcb3f74bbb24fe9cd9feb904c8e16c223a" exitCode=0
Jul 29 10:34:31.786036 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:31.785682    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm" event={"ID":"9a9924be-5124-4322-b7ef-3bf27c821f25","Type":"ContainerDied","Data":"b75c3dedbf82fc5985b82ce6667c9ebcb3f74bbb24fe9cd9feb904c8e16c223a"}
Jul 29 10:34:42.824586 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:42.824554    2567 generic.go:356] "Generic (PLEG): container finished" podID="9a9924be-5124-4322-b7ef-3bf27c821f25" containerID="d3caad3f4ed79a80c199f30353a812264eca1fc61ebabf95dcbdf9c7796dd0ba" exitCode=0
Jul 29 10:34:42.825055 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:42.824597    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm" event={"ID":"9a9924be-5124-4322-b7ef-3bf27c821f25","Type":"ContainerDied","Data":"d3caad3f4ed79a80c199f30353a812264eca1fc61ebabf95dcbdf9c7796dd0ba"}
Jul 29 10:34:50.856754 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:50.856702    2567 generic.go:356] "Generic (PLEG): container finished" podID="9a9924be-5124-4322-b7ef-3bf27c821f25" containerID="a7bd9ad3bf32b16405420b8fadc5617c98c81c873505b6f6b22887e7110eeb46" exitCode=0
Jul 29 10:34:50.857118 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:50.856789    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm" event={"ID":"9a9924be-5124-4322-b7ef-3bf27c821f25","Type":"ContainerDied","Data":"a7bd9ad3bf32b16405420b8fadc5617c98c81c873505b6f6b22887e7110eeb46"}
Jul 29 10:34:51.978703 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:51.978674    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm"
Jul 29 10:34:52.085944 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:52.085914    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xcsz\" (UniqueName: \"kubernetes.io/projected/9a9924be-5124-4322-b7ef-3bf27c821f25-kube-api-access-6xcsz\") pod \"9a9924be-5124-4322-b7ef-3bf27c821f25\" (UID: \"9a9924be-5124-4322-b7ef-3bf27c821f25\") "
Jul 29 10:34:52.086110 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:52.085964    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a9924be-5124-4322-b7ef-3bf27c821f25-util\") pod \"9a9924be-5124-4322-b7ef-3bf27c821f25\" (UID: \"9a9924be-5124-4322-b7ef-3bf27c821f25\") "
Jul 29 10:34:52.086110 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:52.086011    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a9924be-5124-4322-b7ef-3bf27c821f25-bundle\") pod \"9a9924be-5124-4322-b7ef-3bf27c821f25\" (UID: \"9a9924be-5124-4322-b7ef-3bf27c821f25\") "
Jul 29 10:34:52.086673 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:52.086652    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9924be-5124-4322-b7ef-3bf27c821f25-bundle" (OuterVolumeSpecName: "bundle") pod "9a9924be-5124-4322-b7ef-3bf27c821f25" (UID: "9a9924be-5124-4322-b7ef-3bf27c821f25"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 10:34:52.088106 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:52.088074    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a9924be-5124-4322-b7ef-3bf27c821f25-kube-api-access-6xcsz" (OuterVolumeSpecName: "kube-api-access-6xcsz") pod "9a9924be-5124-4322-b7ef-3bf27c821f25" (UID: "9a9924be-5124-4322-b7ef-3bf27c821f25"). InnerVolumeSpecName "kube-api-access-6xcsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 10:34:52.090306 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:52.090284    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9924be-5124-4322-b7ef-3bf27c821f25-util" (OuterVolumeSpecName: "util") pod "9a9924be-5124-4322-b7ef-3bf27c821f25" (UID: "9a9924be-5124-4322-b7ef-3bf27c821f25"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 10:34:52.187374 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:52.187336    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xcsz\" (UniqueName: \"kubernetes.io/projected/9a9924be-5124-4322-b7ef-3bf27c821f25-kube-api-access-6xcsz\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:34:52.187374 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:52.187370    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a9924be-5124-4322-b7ef-3bf27c821f25-util\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:34:52.187374 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:52.187382    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a9924be-5124-4322-b7ef-3bf27c821f25-bundle\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:34:52.865103 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:52.865027    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm"
Jul 29 10:34:52.865103 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:52.865034    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5zs2sm" event={"ID":"9a9924be-5124-4322-b7ef-3bf27c821f25","Type":"ContainerDied","Data":"f0915686ff2b116d33f93920e85c2ab2288f83fc789edec74a41dbac1b142701"}
Jul 29 10:34:52.865103 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:52.865079    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0915686ff2b116d33f93920e85c2ab2288f83fc789edec74a41dbac1b142701"
Jul 29 10:34:56.774355 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:56.774321    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh"]
Jul 29 10:34:56.774747 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:56.774556    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9924be-5124-4322-b7ef-3bf27c821f25" containerName="extract"
Jul 29 10:34:56.774747 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:56.774566    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9924be-5124-4322-b7ef-3bf27c821f25" containerName="extract"
Jul 29 10:34:56.774747 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:56.774582    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9924be-5124-4322-b7ef-3bf27c821f25" containerName="util"
Jul 29 10:34:56.774747 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:56.774587    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9924be-5124-4322-b7ef-3bf27c821f25" containerName="util"
Jul 29 10:34:56.774747 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:56.774594    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9924be-5124-4322-b7ef-3bf27c821f25" containerName="pull"
Jul 29 10:34:56.774747 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:56.774599    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9924be-5124-4322-b7ef-3bf27c821f25" containerName="pull"
Jul 29 10:34:56.774747 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:56.774648    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a9924be-5124-4322-b7ef-3bf27c821f25" containerName="extract"
Jul 29 10:34:56.776568 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:56.776548    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh"
Jul 29 10:34:56.779641 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:56.779619    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 29 10:34:56.779641 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:56.779626    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 29 10:34:56.779813 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:56.779633    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-6z2kp\""
Jul 29 10:34:56.779813 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:56.779657    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 29 10:34:56.793264 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:56.793239    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh"]
Jul 29 10:34:56.922902 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:56.922860    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/3e98eb7f-f52d-4389-84c3-4b39f1f7a9ca-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh\" (UID: \"3e98eb7f-f52d-4389-84c3-4b39f1f7a9ca\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh"
Jul 29 10:34:56.923098 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:56.922960    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddbmw\" (UniqueName: \"kubernetes.io/projected/3e98eb7f-f52d-4389-84c3-4b39f1f7a9ca-kube-api-access-ddbmw\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh\" (UID: \"3e98eb7f-f52d-4389-84c3-4b39f1f7a9ca\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh"
Jul 29 10:34:57.024320 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:57.024268    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddbmw\" (UniqueName: \"kubernetes.io/projected/3e98eb7f-f52d-4389-84c3-4b39f1f7a9ca-kube-api-access-ddbmw\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh\" (UID: \"3e98eb7f-f52d-4389-84c3-4b39f1f7a9ca\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh"
Jul 29 10:34:57.024521 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:57.024381    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/3e98eb7f-f52d-4389-84c3-4b39f1f7a9ca-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh\" (UID: \"3e98eb7f-f52d-4389-84c3-4b39f1f7a9ca\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh"
Jul 29 10:34:57.026673 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:57.026650    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/3e98eb7f-f52d-4389-84c3-4b39f1f7a9ca-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh\" (UID: \"3e98eb7f-f52d-4389-84c3-4b39f1f7a9ca\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh"
Jul 29 10:34:57.033156 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:57.033129    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddbmw\" (UniqueName: \"kubernetes.io/projected/3e98eb7f-f52d-4389-84c3-4b39f1f7a9ca-kube-api-access-ddbmw\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh\" (UID: \"3e98eb7f-f52d-4389-84c3-4b39f1f7a9ca\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh"
Jul 29 10:34:57.086487 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:57.086459    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh"
Jul 29 10:34:57.215860 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:57.215770    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh"]
Jul 29 10:34:57.218180 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:34:57.218154    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e98eb7f_f52d_4389_84c3_4b39f1f7a9ca.slice/crio-2bb3bfce9ca525f8528a05265548c795e2503378959c526aacfae7d7262f8c84 WatchSource:0}: Error finding container 2bb3bfce9ca525f8528a05265548c795e2503378959c526aacfae7d7262f8c84: Status 404 returned error can't find the container with id 2bb3bfce9ca525f8528a05265548c795e2503378959c526aacfae7d7262f8c84
Jul 29 10:34:57.884512 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:57.884469    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh" event={"ID":"3e98eb7f-f52d-4389-84c3-4b39f1f7a9ca","Type":"ContainerStarted","Data":"2bb3bfce9ca525f8528a05265548c795e2503378959c526aacfae7d7262f8c84"}
Jul 29 10:34:59.893095 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:59.893061    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh" event={"ID":"3e98eb7f-f52d-4389-84c3-4b39f1f7a9ca","Type":"ContainerStarted","Data":"5dc9266c3004958478037e3ce41897b04f177d72e56d3e881d231ed165362a3a"}
Jul 29 10:34:59.893522 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:59.893191    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh"
Jul 29 10:34:59.917108 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:34:59.917063    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh" podStartSLOduration=1.362630584 podStartE2EDuration="3.917049099s" totalImagesPullingTime="2.554418515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:34:59.915520361 +0000 UTC m=+349.860759210" watchObservedRunningTime="2026-07-29 10:34:59.917049099 +0000 UTC m=+349.862287945"
Jul 29 10:35:00.501586 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.501549    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-q9p5w"]
Jul 29 10:35:00.503798 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.503777    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-q9p5w"
Jul 29 10:35:00.506805 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.506783    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Jul 29 10:35:00.506805 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.506794    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-tlms5\""
Jul 29 10:35:00.506953 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.506854    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 29 10:35:00.515558 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.515530    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-q9p5w"]
Jul 29 10:35:00.552020 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.551976    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4gmg\" (UniqueName: \"kubernetes.io/projected/58bae62b-859b-4366-ae37-2bf1c084e934-kube-api-access-v4gmg\") pod \"keda-operator-77f648d694-q9p5w\" (UID: \"58bae62b-859b-4366-ae37-2bf1c084e934\") " pod="openshift-keda/keda-operator-77f648d694-q9p5w"
Jul 29 10:35:00.552178 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.552057    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/58bae62b-859b-4366-ae37-2bf1c084e934-cabundle0\") pod \"keda-operator-77f648d694-q9p5w\" (UID: \"58bae62b-859b-4366-ae37-2bf1c084e934\") " pod="openshift-keda/keda-operator-77f648d694-q9p5w"
Jul 29 10:35:00.552178 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.552085    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/58bae62b-859b-4366-ae37-2bf1c084e934-certificates\") pod \"keda-operator-77f648d694-q9p5w\" (UID: \"58bae62b-859b-4366-ae37-2bf1c084e934\") " pod="openshift-keda/keda-operator-77f648d694-q9p5w"
Jul 29 10:35:00.652464 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.652421    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4gmg\" (UniqueName: \"kubernetes.io/projected/58bae62b-859b-4366-ae37-2bf1c084e934-kube-api-access-v4gmg\") pod \"keda-operator-77f648d694-q9p5w\" (UID: \"58bae62b-859b-4366-ae37-2bf1c084e934\") " pod="openshift-keda/keda-operator-77f648d694-q9p5w"
Jul 29 10:35:00.652464 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.652470    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/58bae62b-859b-4366-ae37-2bf1c084e934-cabundle0\") pod \"keda-operator-77f648d694-q9p5w\" (UID: \"58bae62b-859b-4366-ae37-2bf1c084e934\") " pod="openshift-keda/keda-operator-77f648d694-q9p5w"
Jul 29 10:35:00.652741 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.652490    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/58bae62b-859b-4366-ae37-2bf1c084e934-certificates\") pod \"keda-operator-77f648d694-q9p5w\" (UID: \"58bae62b-859b-4366-ae37-2bf1c084e934\") " pod="openshift-keda/keda-operator-77f648d694-q9p5w"
Jul 29 10:35:00.652741 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:35:00.652576    2567 secret.go:281] references non-existent secret key: ca.crt
Jul 29 10:35:00.652741 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:35:00.652593    2567 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 29 10:35:00.652741 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:35:00.652603    2567 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-q9p5w: references non-existent secret key: ca.crt
Jul 29 10:35:00.652741 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:35:00.652671    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58bae62b-859b-4366-ae37-2bf1c084e934-certificates podName:58bae62b-859b-4366-ae37-2bf1c084e934 nodeName:}" failed. No retries permitted until 2026-07-29 10:35:01.152650051 +0000 UTC m=+351.097888883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/58bae62b-859b-4366-ae37-2bf1c084e934-certificates") pod "keda-operator-77f648d694-q9p5w" (UID: "58bae62b-859b-4366-ae37-2bf1c084e934") : references non-existent secret key: ca.crt
Jul 29 10:35:00.653225 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.653203    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/58bae62b-859b-4366-ae37-2bf1c084e934-cabundle0\") pod \"keda-operator-77f648d694-q9p5w\" (UID: \"58bae62b-859b-4366-ae37-2bf1c084e934\") " pod="openshift-keda/keda-operator-77f648d694-q9p5w"
Jul 29 10:35:00.663290 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.663266    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4gmg\" (UniqueName: \"kubernetes.io/projected/58bae62b-859b-4366-ae37-2bf1c084e934-kube-api-access-v4gmg\") pod \"keda-operator-77f648d694-q9p5w\" (UID: \"58bae62b-859b-4366-ae37-2bf1c084e934\") " pod="openshift-keda/keda-operator-77f648d694-q9p5w"
Jul 29 10:35:00.860316 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.860213    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-fqx22"]
Jul 29 10:35:00.862567 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.862543    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-fqx22"
Jul 29 10:35:00.865242 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.865222    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Jul 29 10:35:00.872308 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.872274    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-fqx22"]
Jul 29 10:35:00.954464 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.954425    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68trs\" (UniqueName: \"kubernetes.io/projected/d07091f5-6ddf-4da4-92f2-de40919bf122-kube-api-access-68trs\") pod \"keda-metrics-apiserver-55557df8c-fqx22\" (UID: \"d07091f5-6ddf-4da4-92f2-de40919bf122\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-fqx22"
Jul 29 10:35:00.954932 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.954476    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/d07091f5-6ddf-4da4-92f2-de40919bf122-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-fqx22\" (UID: \"d07091f5-6ddf-4da4-92f2-de40919bf122\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-fqx22"
Jul 29 10:35:00.954932 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.954548    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d07091f5-6ddf-4da4-92f2-de40919bf122-certificates\") pod \"keda-metrics-apiserver-55557df8c-fqx22\" (UID: \"d07091f5-6ddf-4da4-92f2-de40919bf122\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-fqx22"
Jul 29 10:35:00.990111 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.990083    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-tpjsd"]
Jul 29 10:35:00.992184 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.992166    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-tpjsd"
Jul 29 10:35:00.994979 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:00.994958    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Jul 29 10:35:01.005051 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.005026    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-tpjsd"]
Jul 29 10:35:01.056399 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.056366    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68trs\" (UniqueName: \"kubernetes.io/projected/d07091f5-6ddf-4da4-92f2-de40919bf122-kube-api-access-68trs\") pod \"keda-metrics-apiserver-55557df8c-fqx22\" (UID: \"d07091f5-6ddf-4da4-92f2-de40919bf122\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-fqx22"
Jul 29 10:35:01.056399 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.056403    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5fc2\" (UniqueName: \"kubernetes.io/projected/7139e666-4a51-43fa-af92-335354b2297e-kube-api-access-w5fc2\") pod \"keda-admission-56f9798bb4-tpjsd\" (UID: \"7139e666-4a51-43fa-af92-335354b2297e\") " pod="openshift-keda/keda-admission-56f9798bb4-tpjsd"
Jul 29 10:35:01.056650 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.056430    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/d07091f5-6ddf-4da4-92f2-de40919bf122-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-fqx22\" (UID: \"d07091f5-6ddf-4da4-92f2-de40919bf122\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-fqx22"
Jul 29 10:35:01.056650 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.056540    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d07091f5-6ddf-4da4-92f2-de40919bf122-certificates\") pod \"keda-metrics-apiserver-55557df8c-fqx22\" (UID: \"d07091f5-6ddf-4da4-92f2-de40919bf122\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-fqx22"
Jul 29 10:35:01.056650 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.056599    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/7139e666-4a51-43fa-af92-335354b2297e-certificates\") pod \"keda-admission-56f9798bb4-tpjsd\" (UID: \"7139e666-4a51-43fa-af92-335354b2297e\") " pod="openshift-keda/keda-admission-56f9798bb4-tpjsd"
Jul 29 10:35:01.056842 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.056708    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/d07091f5-6ddf-4da4-92f2-de40919bf122-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-fqx22\" (UID: \"d07091f5-6ddf-4da4-92f2-de40919bf122\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-fqx22"
Jul 29 10:35:01.059065 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.059041    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d07091f5-6ddf-4da4-92f2-de40919bf122-certificates\") pod \"keda-metrics-apiserver-55557df8c-fqx22\" (UID: \"d07091f5-6ddf-4da4-92f2-de40919bf122\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-fqx22"
Jul 29 10:35:01.066387 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.066362    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68trs\" (UniqueName: \"kubernetes.io/projected/d07091f5-6ddf-4da4-92f2-de40919bf122-kube-api-access-68trs\") pod \"keda-metrics-apiserver-55557df8c-fqx22\" (UID: \"d07091f5-6ddf-4da4-92f2-de40919bf122\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-fqx22"
Jul 29 10:35:01.157389 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.157356    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/58bae62b-859b-4366-ae37-2bf1c084e934-certificates\") pod \"keda-operator-77f648d694-q9p5w\" (UID: \"58bae62b-859b-4366-ae37-2bf1c084e934\") " pod="openshift-keda/keda-operator-77f648d694-q9p5w"
Jul 29 10:35:01.157584 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.157434    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/7139e666-4a51-43fa-af92-335354b2297e-certificates\") pod \"keda-admission-56f9798bb4-tpjsd\" (UID: \"7139e666-4a51-43fa-af92-335354b2297e\") " pod="openshift-keda/keda-admission-56f9798bb4-tpjsd"
Jul 29 10:35:01.157584 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.157472    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5fc2\" (UniqueName: \"kubernetes.io/projected/7139e666-4a51-43fa-af92-335354b2297e-kube-api-access-w5fc2\") pod \"keda-admission-56f9798bb4-tpjsd\" (UID: \"7139e666-4a51-43fa-af92-335354b2297e\") " pod="openshift-keda/keda-admission-56f9798bb4-tpjsd"
Jul 29 10:35:01.157676 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:35:01.157590    2567 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found
Jul 29 10:35:01.157676 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:35:01.157617    2567 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-56f9798bb4-tpjsd: secret "keda-admission-webhooks-certs" not found
Jul 29 10:35:01.157676 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:35:01.157673    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7139e666-4a51-43fa-af92-335354b2297e-certificates podName:7139e666-4a51-43fa-af92-335354b2297e nodeName:}" failed. No retries permitted until 2026-07-29 10:35:01.6576561 +0000 UTC m=+351.602894924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/7139e666-4a51-43fa-af92-335354b2297e-certificates") pod "keda-admission-56f9798bb4-tpjsd" (UID: "7139e666-4a51-43fa-af92-335354b2297e") : secret "keda-admission-webhooks-certs" not found
Jul 29 10:35:01.160140 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.160108    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/58bae62b-859b-4366-ae37-2bf1c084e934-certificates\") pod \"keda-operator-77f648d694-q9p5w\" (UID: \"58bae62b-859b-4366-ae37-2bf1c084e934\") " pod="openshift-keda/keda-operator-77f648d694-q9p5w"
Jul 29 10:35:01.172908 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.172882    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-fqx22"
Jul 29 10:35:01.175912 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.175889    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5fc2\" (UniqueName: \"kubernetes.io/projected/7139e666-4a51-43fa-af92-335354b2297e-kube-api-access-w5fc2\") pod \"keda-admission-56f9798bb4-tpjsd\" (UID: \"7139e666-4a51-43fa-af92-335354b2297e\") " pod="openshift-keda/keda-admission-56f9798bb4-tpjsd"
Jul 29 10:35:01.316752 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.316691    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-fqx22"]
Jul 29 10:35:01.320134 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:35:01.320104    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd07091f5_6ddf_4da4_92f2_de40919bf122.slice/crio-4f5d29256b05aa146c261f185c33433d9afba60bada8678000d323ebf8cb45ac WatchSource:0}: Error finding container 4f5d29256b05aa146c261f185c33433d9afba60bada8678000d323ebf8cb45ac: Status 404 returned error can't find the container with id 4f5d29256b05aa146c261f185c33433d9afba60bada8678000d323ebf8cb45ac
Jul 29 10:35:01.413929 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.413838    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-q9p5w"
Jul 29 10:35:01.591184 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.591112    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-q9p5w"]
Jul 29 10:35:01.593899 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:35:01.593871    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58bae62b_859b_4366_ae37_2bf1c084e934.slice/crio-a43b4921628f63784cb2bbf1ed48771d97fce9aec0c5d922d0ba499ba32f17c2 WatchSource:0}: Error finding container a43b4921628f63784cb2bbf1ed48771d97fce9aec0c5d922d0ba499ba32f17c2: Status 404 returned error can't find the container with id a43b4921628f63784cb2bbf1ed48771d97fce9aec0c5d922d0ba499ba32f17c2
Jul 29 10:35:01.662840 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.662804    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/7139e666-4a51-43fa-af92-335354b2297e-certificates\") pod \"keda-admission-56f9798bb4-tpjsd\" (UID: \"7139e666-4a51-43fa-af92-335354b2297e\") " pod="openshift-keda/keda-admission-56f9798bb4-tpjsd"
Jul 29 10:35:01.665437 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.665369    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/7139e666-4a51-43fa-af92-335354b2297e-certificates\") pod \"keda-admission-56f9798bb4-tpjsd\" (UID: \"7139e666-4a51-43fa-af92-335354b2297e\") " pod="openshift-keda/keda-admission-56f9798bb4-tpjsd"
Jul 29 10:35:01.902153 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.902112    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-q9p5w" event={"ID":"58bae62b-859b-4366-ae37-2bf1c084e934","Type":"ContainerStarted","Data":"a43b4921628f63784cb2bbf1ed48771d97fce9aec0c5d922d0ba499ba32f17c2"}
Jul 29 10:35:01.903168 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.903140    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-fqx22" event={"ID":"d07091f5-6ddf-4da4-92f2-de40919bf122","Type":"ContainerStarted","Data":"4f5d29256b05aa146c261f185c33433d9afba60bada8678000d323ebf8cb45ac"}
Jul 29 10:35:01.925508 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:01.925422    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-tpjsd"
Jul 29 10:35:02.064068 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:02.063910    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-tpjsd"]
Jul 29 10:35:02.067129 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:35:02.067092    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7139e666_4a51_43fa_af92_335354b2297e.slice/crio-779e500a12372bc0b976c0a942e5544fb2d1c7dac9f31066632a2fea71350e60 WatchSource:0}: Error finding container 779e500a12372bc0b976c0a942e5544fb2d1c7dac9f31066632a2fea71350e60: Status 404 returned error can't find the container with id 779e500a12372bc0b976c0a942e5544fb2d1c7dac9f31066632a2fea71350e60
Jul 29 10:35:02.908175 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:02.908136    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-tpjsd" event={"ID":"7139e666-4a51-43fa-af92-335354b2297e","Type":"ContainerStarted","Data":"779e500a12372bc0b976c0a942e5544fb2d1c7dac9f31066632a2fea71350e60"}
Jul 29 10:35:04.917687 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:04.917642    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-tpjsd" event={"ID":"7139e666-4a51-43fa-af92-335354b2297e","Type":"ContainerStarted","Data":"0e9ee673adac98eb5b90d99e53b7c2168045ebf6bfceb0a1f9863a05b656fb19"}
Jul 29 10:35:04.918156 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:04.917786    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-tpjsd"
Jul 29 10:35:04.944111 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:04.944049    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-tpjsd" podStartSLOduration=2.663887267 podStartE2EDuration="4.944026498s" totalImagesPullingTime="2.280139231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:35:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:35:04.941901121 +0000 UTC m=+354.887139993" watchObservedRunningTime="2026-07-29 10:35:04.944026498 +0000 UTC m=+354.889265325"
Jul 29 10:35:06.927309 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:06.927272    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-fqx22" event={"ID":"d07091f5-6ddf-4da4-92f2-de40919bf122","Type":"ContainerStarted","Data":"d9d3c569c5e3e667fb06e18da10146ad682bbcd3f154e8f04e83cd34e6892fdb"}
Jul 29 10:35:06.927743 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:06.927383    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-fqx22"
Jul 29 10:35:06.946246 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:06.946194    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-fqx22" podStartSLOduration=1.865781812 podStartE2EDuration="6.946175828s" totalImagesPullingTime="5.080394016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:35:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:35:06.944566388 +0000 UTC m=+356.889805265" watchObservedRunningTime="2026-07-29 10:35:06.946175828 +0000 UTC m=+356.891414676"
Jul 29 10:35:11.947206 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:11.947168    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-q9p5w" event={"ID":"58bae62b-859b-4366-ae37-2bf1c084e934","Type":"ContainerStarted","Data":"9a77fb1b1958cf105be72ecd3199a572e0f059f3e788e978dc9959e53293694d"}
Jul 29 10:35:11.947694 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:11.947239    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-q9p5w"
Jul 29 10:35:11.966263 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:11.966218    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-q9p5w" podStartSLOduration=2.425250401 podStartE2EDuration="11.966204774s" totalImagesPullingTime="9.540954373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:35:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:35:11.965322393 +0000 UTC m=+361.910561240" watchObservedRunningTime="2026-07-29 10:35:11.966204774 +0000 UTC m=+361.911443619"
Jul 29 10:35:17.939967 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:17.936986    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-fqx22"
Jul 29 10:35:20.900677 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:20.900643    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-g5qmh"
Jul 29 10:35:25.925054 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:25.925021    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-tpjsd"
Jul 29 10:35:32.953398 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:35:32.953365    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-q9p5w"
Jul 29 10:36:20.254911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.254877    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-65f566c74b-xdhcd"]
Jul 29 10:36:20.257179 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.257159    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-65f566c74b-xdhcd"
Jul 29 10:36:20.260016 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.259999    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Jul 29 10:36:20.261345 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.261327    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-bhcm7\""
Jul 29 10:36:20.261457 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.261347    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 29 10:36:20.261457 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.261404    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 29 10:36:20.264498 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.264312    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-nzjgw"]
Jul 29 10:36:20.266667 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.266647    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84fc959947-nzjgw"
Jul 29 10:36:20.276406 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.270021    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-ppl6z\""
Jul 29 10:36:20.276406 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.270233    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Jul 29 10:36:20.276406 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.270752    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-65f566c74b-xdhcd"]
Jul 29 10:36:20.283530 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.283506    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-nzjgw"]
Jul 29 10:36:20.284822 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.284793    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fljpk\" (UniqueName: \"kubernetes.io/projected/d07d349e-47af-482f-892a-494f7acee378-kube-api-access-fljpk\") pod \"kserve-controller-manager-65f566c74b-xdhcd\" (UID: \"d07d349e-47af-482f-892a-494f7acee378\") " pod="kserve/kserve-controller-manager-65f566c74b-xdhcd"
Jul 29 10:36:20.284947 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.284886    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0195d7b4-25f1-4701-b35e-a13659e80924-cert\") pod \"llmisvc-controller-manager-84fc959947-nzjgw\" (UID: \"0195d7b4-25f1-4701-b35e-a13659e80924\") " pod="kserve/llmisvc-controller-manager-84fc959947-nzjgw"
Jul 29 10:36:20.285013 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.284959    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfbs9\" (UniqueName: \"kubernetes.io/projected/0195d7b4-25f1-4701-b35e-a13659e80924-kube-api-access-wfbs9\") pod \"llmisvc-controller-manager-84fc959947-nzjgw\" (UID: \"0195d7b4-25f1-4701-b35e-a13659e80924\") " pod="kserve/llmisvc-controller-manager-84fc959947-nzjgw"
Jul 29 10:36:20.285182 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.285007    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d07d349e-47af-482f-892a-494f7acee378-cert\") pod \"kserve-controller-manager-65f566c74b-xdhcd\" (UID: \"d07d349e-47af-482f-892a-494f7acee378\") " pod="kserve/kserve-controller-manager-65f566c74b-xdhcd"
Jul 29 10:36:20.385774 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.385708    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfbs9\" (UniqueName: \"kubernetes.io/projected/0195d7b4-25f1-4701-b35e-a13659e80924-kube-api-access-wfbs9\") pod \"llmisvc-controller-manager-84fc959947-nzjgw\" (UID: \"0195d7b4-25f1-4701-b35e-a13659e80924\") " pod="kserve/llmisvc-controller-manager-84fc959947-nzjgw"
Jul 29 10:36:20.385964 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.385797    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d07d349e-47af-482f-892a-494f7acee378-cert\") pod \"kserve-controller-manager-65f566c74b-xdhcd\" (UID: \"d07d349e-47af-482f-892a-494f7acee378\") " pod="kserve/kserve-controller-manager-65f566c74b-xdhcd"
Jul 29 10:36:20.385964 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.385845    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fljpk\" (UniqueName: \"kubernetes.io/projected/d07d349e-47af-482f-892a-494f7acee378-kube-api-access-fljpk\") pod \"kserve-controller-manager-65f566c74b-xdhcd\" (UID: \"d07d349e-47af-482f-892a-494f7acee378\") " pod="kserve/kserve-controller-manager-65f566c74b-xdhcd"
Jul 29 10:36:20.385964 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.385891    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0195d7b4-25f1-4701-b35e-a13659e80924-cert\") pod \"llmisvc-controller-manager-84fc959947-nzjgw\" (UID: \"0195d7b4-25f1-4701-b35e-a13659e80924\") " pod="kserve/llmisvc-controller-manager-84fc959947-nzjgw"
Jul 29 10:36:20.385964 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:36:20.385946    2567 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 29 10:36:20.386107 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:36:20.386022    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d07d349e-47af-482f-892a-494f7acee378-cert podName:d07d349e-47af-482f-892a-494f7acee378 nodeName:}" failed. No retries permitted until 2026-07-29 10:36:20.886003909 +0000 UTC m=+430.831242742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d07d349e-47af-482f-892a-494f7acee378-cert") pod "kserve-controller-manager-65f566c74b-xdhcd" (UID: "d07d349e-47af-482f-892a-494f7acee378") : secret "kserve-webhook-server-cert" not found
Jul 29 10:36:20.388332 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.388307    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0195d7b4-25f1-4701-b35e-a13659e80924-cert\") pod \"llmisvc-controller-manager-84fc959947-nzjgw\" (UID: \"0195d7b4-25f1-4701-b35e-a13659e80924\") " pod="kserve/llmisvc-controller-manager-84fc959947-nzjgw"
Jul 29 10:36:20.397235 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.397207    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fljpk\" (UniqueName: \"kubernetes.io/projected/d07d349e-47af-482f-892a-494f7acee378-kube-api-access-fljpk\") pod \"kserve-controller-manager-65f566c74b-xdhcd\" (UID: \"d07d349e-47af-482f-892a-494f7acee378\") " pod="kserve/kserve-controller-manager-65f566c74b-xdhcd"
Jul 29 10:36:20.397768 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.397750    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfbs9\" (UniqueName: \"kubernetes.io/projected/0195d7b4-25f1-4701-b35e-a13659e80924-kube-api-access-wfbs9\") pod \"llmisvc-controller-manager-84fc959947-nzjgw\" (UID: \"0195d7b4-25f1-4701-b35e-a13659e80924\") " pod="kserve/llmisvc-controller-manager-84fc959947-nzjgw"
Jul 29 10:36:20.590818 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.590740    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84fc959947-nzjgw"
Jul 29 10:36:20.716375 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.716343    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-nzjgw"]
Jul 29 10:36:20.719375 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:36:20.719340    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0195d7b4_25f1_4701_b35e_a13659e80924.slice/crio-9b291fe134e0e1016d08f9bb5eb6f82fabba821929618c0e4fa801d21247b99c WatchSource:0}: Error finding container 9b291fe134e0e1016d08f9bb5eb6f82fabba821929618c0e4fa801d21247b99c: Status 404 returned error can't find the container with id 9b291fe134e0e1016d08f9bb5eb6f82fabba821929618c0e4fa801d21247b99c
Jul 29 10:36:20.889651 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:20.889610    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d07d349e-47af-482f-892a-494f7acee378-cert\") pod \"kserve-controller-manager-65f566c74b-xdhcd\" (UID: \"d07d349e-47af-482f-892a-494f7acee378\") " pod="kserve/kserve-controller-manager-65f566c74b-xdhcd"
Jul 29 10:36:20.889857 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:36:20.889766    2567 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 29 10:36:20.889857 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:36:20.889837    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d07d349e-47af-482f-892a-494f7acee378-cert podName:d07d349e-47af-482f-892a-494f7acee378 nodeName:}" failed. No retries permitted until 2026-07-29 10:36:21.889822527 +0000 UTC m=+431.835061354 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d07d349e-47af-482f-892a-494f7acee378-cert") pod "kserve-controller-manager-65f566c74b-xdhcd" (UID: "d07d349e-47af-482f-892a-494f7acee378") : secret "kserve-webhook-server-cert" not found
Jul 29 10:36:21.201210 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:21.201134    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84fc959947-nzjgw" event={"ID":"0195d7b4-25f1-4701-b35e-a13659e80924","Type":"ContainerStarted","Data":"9b291fe134e0e1016d08f9bb5eb6f82fabba821929618c0e4fa801d21247b99c"}
Jul 29 10:36:21.899195 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:21.899154    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d07d349e-47af-482f-892a-494f7acee378-cert\") pod \"kserve-controller-manager-65f566c74b-xdhcd\" (UID: \"d07d349e-47af-482f-892a-494f7acee378\") " pod="kserve/kserve-controller-manager-65f566c74b-xdhcd"
Jul 29 10:36:21.901425 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:21.901404    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d07d349e-47af-482f-892a-494f7acee378-cert\") pod \"kserve-controller-manager-65f566c74b-xdhcd\" (UID: \"d07d349e-47af-482f-892a-494f7acee378\") " pod="kserve/kserve-controller-manager-65f566c74b-xdhcd"
Jul 29 10:36:22.068208 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:22.068172    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-65f566c74b-xdhcd"
Jul 29 10:36:22.230549 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:22.230517    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-65f566c74b-xdhcd"]
Jul 29 10:36:22.234056 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:36:22.234035    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd07d349e_47af_482f_892a_494f7acee378.slice/crio-bf4fbd7c00c8b89c268a46a9b2a2bfdf9db20ade814107917aa787e4621c4a9c WatchSource:0}: Error finding container bf4fbd7c00c8b89c268a46a9b2a2bfdf9db20ade814107917aa787e4621c4a9c: Status 404 returned error can't find the container with id bf4fbd7c00c8b89c268a46a9b2a2bfdf9db20ade814107917aa787e4621c4a9c
Jul 29 10:36:23.216508 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:23.216469    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-65f566c74b-xdhcd" event={"ID":"d07d349e-47af-482f-892a-494f7acee378","Type":"ContainerStarted","Data":"bf4fbd7c00c8b89c268a46a9b2a2bfdf9db20ade814107917aa787e4621c4a9c"}
Jul 29 10:36:24.225952 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:24.225912    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84fc959947-nzjgw" event={"ID":"0195d7b4-25f1-4701-b35e-a13659e80924","Type":"ContainerStarted","Data":"218a07ea0711421bd8a1308483652bc072553ad50b20a1107b25e74dd03548f3"}
Jul 29 10:36:24.226384 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:24.226019    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-84fc959947-nzjgw"
Jul 29 10:36:24.258576 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:24.258523    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-84fc959947-nzjgw" podStartSLOduration=1.872285253 podStartE2EDuration="4.258506656s" totalImagesPullingTime="2.386221403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:36:24.258327895 +0000 UTC m=+434.203566771" watchObservedRunningTime="2026-07-29 10:36:24.258506656 +0000 UTC m=+434.203745502"
Jul 29 10:36:25.233904 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:25.233864    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-65f566c74b-xdhcd" event={"ID":"d07d349e-47af-482f-892a-494f7acee378","Type":"ContainerStarted","Data":"81cd15b5db31e415fa525da371659f64c41cda42f13a404caf0e07340e774c44"}
Jul 29 10:36:25.234351 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:25.233952    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-65f566c74b-xdhcd"
Jul 29 10:36:25.252272 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:25.252223    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-65f566c74b-xdhcd" podStartSLOduration=2.348419494 podStartE2EDuration="5.252207319s" totalImagesPullingTime="2.903787825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:36:25.250861144 +0000 UTC m=+435.196100013" watchObservedRunningTime="2026-07-29 10:36:25.252207319 +0000 UTC m=+435.197446165"
Jul 29 10:36:55.235929 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:55.235850    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-84fc959947-nzjgw"
Jul 29 10:36:56.244606 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:36:56.244571    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-65f566c74b-xdhcd"
Jul 29 10:37:02.547846 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:02.547805    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-65f566c74b-xdhcd"]
Jul 29 10:37:02.548393 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:02.548084    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-65f566c74b-xdhcd" podUID="d07d349e-47af-482f-892a-494f7acee378" containerName="manager" containerID="cri-o://81cd15b5db31e415fa525da371659f64c41cda42f13a404caf0e07340e774c44" gracePeriod=10
Jul 29 10:37:02.566346 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:02.566320    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-65f566c74b-xghf8"]
Jul 29 10:37:02.568438 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:02.568417    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-65f566c74b-xghf8"
Jul 29 10:37:02.580400 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:02.580371    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-65f566c74b-xghf8"]
Jul 29 10:37:02.745432 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:02.745395    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea4e0ad4-5ec0-4b77-b6ba-aa93cae3abd6-cert\") pod \"kserve-controller-manager-65f566c74b-xghf8\" (UID: \"ea4e0ad4-5ec0-4b77-b6ba-aa93cae3abd6\") " pod="kserve/kserve-controller-manager-65f566c74b-xghf8"
Jul 29 10:37:02.745586 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:02.745501    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpbj6\" (UniqueName: \"kubernetes.io/projected/ea4e0ad4-5ec0-4b77-b6ba-aa93cae3abd6-kube-api-access-qpbj6\") pod \"kserve-controller-manager-65f566c74b-xghf8\" (UID: \"ea4e0ad4-5ec0-4b77-b6ba-aa93cae3abd6\") " pod="kserve/kserve-controller-manager-65f566c74b-xghf8"
Jul 29 10:37:02.788133 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:02.788109    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-65f566c74b-xdhcd"
Jul 29 10:37:02.846606 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:02.846523    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpbj6\" (UniqueName: \"kubernetes.io/projected/ea4e0ad4-5ec0-4b77-b6ba-aa93cae3abd6-kube-api-access-qpbj6\") pod \"kserve-controller-manager-65f566c74b-xghf8\" (UID: \"ea4e0ad4-5ec0-4b77-b6ba-aa93cae3abd6\") " pod="kserve/kserve-controller-manager-65f566c74b-xghf8"
Jul 29 10:37:02.846606 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:02.846585    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea4e0ad4-5ec0-4b77-b6ba-aa93cae3abd6-cert\") pod \"kserve-controller-manager-65f566c74b-xghf8\" (UID: \"ea4e0ad4-5ec0-4b77-b6ba-aa93cae3abd6\") " pod="kserve/kserve-controller-manager-65f566c74b-xghf8"
Jul 29 10:37:02.848942 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:02.848917    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea4e0ad4-5ec0-4b77-b6ba-aa93cae3abd6-cert\") pod \"kserve-controller-manager-65f566c74b-xghf8\" (UID: \"ea4e0ad4-5ec0-4b77-b6ba-aa93cae3abd6\") " pod="kserve/kserve-controller-manager-65f566c74b-xghf8"
Jul 29 10:37:02.855377 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:02.855333    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpbj6\" (UniqueName: \"kubernetes.io/projected/ea4e0ad4-5ec0-4b77-b6ba-aa93cae3abd6-kube-api-access-qpbj6\") pod \"kserve-controller-manager-65f566c74b-xghf8\" (UID: \"ea4e0ad4-5ec0-4b77-b6ba-aa93cae3abd6\") " pod="kserve/kserve-controller-manager-65f566c74b-xghf8"
Jul 29 10:37:02.920213 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:02.920177    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-65f566c74b-xghf8"
Jul 29 10:37:02.947085 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:02.947057    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d07d349e-47af-482f-892a-494f7acee378-cert\") pod \"d07d349e-47af-482f-892a-494f7acee378\" (UID: \"d07d349e-47af-482f-892a-494f7acee378\") "
Jul 29 10:37:02.947223 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:02.947118    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fljpk\" (UniqueName: \"kubernetes.io/projected/d07d349e-47af-482f-892a-494f7acee378-kube-api-access-fljpk\") pod \"d07d349e-47af-482f-892a-494f7acee378\" (UID: \"d07d349e-47af-482f-892a-494f7acee378\") "
Jul 29 10:37:02.949228 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:02.949192    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d07d349e-47af-482f-892a-494f7acee378-cert" (OuterVolumeSpecName: "cert") pod "d07d349e-47af-482f-892a-494f7acee378" (UID: "d07d349e-47af-482f-892a-494f7acee378"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 10:37:02.949228 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:02.949215    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d07d349e-47af-482f-892a-494f7acee378-kube-api-access-fljpk" (OuterVolumeSpecName: "kube-api-access-fljpk") pod "d07d349e-47af-482f-892a-494f7acee378" (UID: "d07d349e-47af-482f-892a-494f7acee378"). InnerVolumeSpecName "kube-api-access-fljpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 10:37:03.046386 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:03.046363    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-65f566c74b-xghf8"]
Jul 29 10:37:03.048030 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:03.048008    2567 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d07d349e-47af-482f-892a-494f7acee378-cert\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:37:03.048122 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:03.048033    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fljpk\" (UniqueName: \"kubernetes.io/projected/d07d349e-47af-482f-892a-494f7acee378-kube-api-access-fljpk\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:37:03.048398 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:37:03.048375    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4e0ad4_5ec0_4b77_b6ba_aa93cae3abd6.slice/crio-ade9f9c575c69683c1cd62775f1b3853f004369488dc50e056382ebc197e56c5 WatchSource:0}: Error finding container ade9f9c575c69683c1cd62775f1b3853f004369488dc50e056382ebc197e56c5: Status 404 returned error can't find the container with id ade9f9c575c69683c1cd62775f1b3853f004369488dc50e056382ebc197e56c5
Jul 29 10:37:03.389586 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:03.389553    2567 generic.go:356] "Generic (PLEG): container finished" podID="d07d349e-47af-482f-892a-494f7acee378" containerID="81cd15b5db31e415fa525da371659f64c41cda42f13a404caf0e07340e774c44" exitCode=0
Jul 29 10:37:03.389793 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:03.389603    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-65f566c74b-xdhcd"
Jul 29 10:37:03.389793 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:03.389637    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-65f566c74b-xdhcd" event={"ID":"d07d349e-47af-482f-892a-494f7acee378","Type":"ContainerDied","Data":"81cd15b5db31e415fa525da371659f64c41cda42f13a404caf0e07340e774c44"}
Jul 29 10:37:03.389793 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:03.389686    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-65f566c74b-xdhcd" event={"ID":"d07d349e-47af-482f-892a-494f7acee378","Type":"ContainerDied","Data":"bf4fbd7c00c8b89c268a46a9b2a2bfdf9db20ade814107917aa787e4621c4a9c"}
Jul 29 10:37:03.389793 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:03.389732    2567 scope.go:117] "RemoveContainer" containerID="81cd15b5db31e415fa525da371659f64c41cda42f13a404caf0e07340e774c44"
Jul 29 10:37:03.390911 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:03.390892    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-65f566c74b-xghf8" event={"ID":"ea4e0ad4-5ec0-4b77-b6ba-aa93cae3abd6","Type":"ContainerStarted","Data":"ade9f9c575c69683c1cd62775f1b3853f004369488dc50e056382ebc197e56c5"}
Jul 29 10:37:03.398387 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:03.398367    2567 scope.go:117] "RemoveContainer" containerID="81cd15b5db31e415fa525da371659f64c41cda42f13a404caf0e07340e774c44"
Jul 29 10:37:03.398684 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:37:03.398666    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81cd15b5db31e415fa525da371659f64c41cda42f13a404caf0e07340e774c44\": container with ID starting with 81cd15b5db31e415fa525da371659f64c41cda42f13a404caf0e07340e774c44 not found: ID does not exist" containerID="81cd15b5db31e415fa525da371659f64c41cda42f13a404caf0e07340e774c44"
Jul 29 10:37:03.398755 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:03.398694    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81cd15b5db31e415fa525da371659f64c41cda42f13a404caf0e07340e774c44"} err="failed to get container status \"81cd15b5db31e415fa525da371659f64c41cda42f13a404caf0e07340e774c44\": rpc error: code = NotFound desc = could not find container \"81cd15b5db31e415fa525da371659f64c41cda42f13a404caf0e07340e774c44\": container with ID starting with 81cd15b5db31e415fa525da371659f64c41cda42f13a404caf0e07340e774c44 not found: ID does not exist"
Jul 29 10:37:03.412544 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:03.412516    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-65f566c74b-xdhcd"]
Jul 29 10:37:03.417470 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:03.417445    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-65f566c74b-xdhcd"]
Jul 29 10:37:04.397403 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:04.397369    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-65f566c74b-xghf8" event={"ID":"ea4e0ad4-5ec0-4b77-b6ba-aa93cae3abd6","Type":"ContainerStarted","Data":"ccd2f7e47c74adafb0c74ecab677f9e19ede56186bf8db60b47bc355625110d6"}
Jul 29 10:37:04.397801 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:04.397437    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-65f566c74b-xghf8"
Jul 29 10:37:04.414983 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:04.414916    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-65f566c74b-xghf8" podStartSLOduration=1.921768739 podStartE2EDuration="2.414894893s" totalImagesPullingTime="493.126154ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:37:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:37:04.414489059 +0000 UTC m=+474.359727927" watchObservedRunningTime="2026-07-29 10:37:04.414894893 +0000 UTC m=+474.360133739"
Jul 29 10:37:04.562297 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:04.562263    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d07d349e-47af-482f-892a-494f7acee378" path="/var/lib/kubelet/pods/d07d349e-47af-482f-892a-494f7acee378/volumes"
Jul 29 10:37:35.407418 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:35.407387    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-65f566c74b-xghf8"
Jul 29 10:37:36.425645 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:36.425612    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-2r6rc"]
Jul 29 10:37:36.426017 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:36.425955    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d07d349e-47af-482f-892a-494f7acee378" containerName="manager"
Jul 29 10:37:36.426017 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:36.425966    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d07d349e-47af-482f-892a-494f7acee378" containerName="manager"
Jul 29 10:37:36.426130 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:36.426024    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d07d349e-47af-482f-892a-494f7acee378" containerName="manager"
Jul 29 10:37:36.429075 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:36.429040    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-75d9cdbddf-2r6rc"
Jul 29 10:37:36.433468 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:36.433448    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
Jul 29 10:37:36.433576 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:36.433448    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-msq64\""
Jul 29 10:37:36.441067 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:36.441042    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-2r6rc"]
Jul 29 10:37:36.510731 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:36.510676    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa40a768-cc55-4761-9ec9-b3c1b138e4bf-cert\") pod \"odh-model-controller-75d9cdbddf-2r6rc\" (UID: \"aa40a768-cc55-4761-9ec9-b3c1b138e4bf\") " pod="kserve/odh-model-controller-75d9cdbddf-2r6rc"
Jul 29 10:37:36.510931 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:36.510751    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8hps\" (UniqueName: \"kubernetes.io/projected/aa40a768-cc55-4761-9ec9-b3c1b138e4bf-kube-api-access-g8hps\") pod \"odh-model-controller-75d9cdbddf-2r6rc\" (UID: \"aa40a768-cc55-4761-9ec9-b3c1b138e4bf\") " pod="kserve/odh-model-controller-75d9cdbddf-2r6rc"
Jul 29 10:37:36.611252 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:36.611224    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa40a768-cc55-4761-9ec9-b3c1b138e4bf-cert\") pod \"odh-model-controller-75d9cdbddf-2r6rc\" (UID: \"aa40a768-cc55-4761-9ec9-b3c1b138e4bf\") " pod="kserve/odh-model-controller-75d9cdbddf-2r6rc"
Jul 29 10:37:36.611454 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:36.611282    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8hps\" (UniqueName: \"kubernetes.io/projected/aa40a768-cc55-4761-9ec9-b3c1b138e4bf-kube-api-access-g8hps\") pod \"odh-model-controller-75d9cdbddf-2r6rc\" (UID: \"aa40a768-cc55-4761-9ec9-b3c1b138e4bf\") " pod="kserve/odh-model-controller-75d9cdbddf-2r6rc"
Jul 29 10:37:36.613659 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:36.613640    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa40a768-cc55-4761-9ec9-b3c1b138e4bf-cert\") pod \"odh-model-controller-75d9cdbddf-2r6rc\" (UID: \"aa40a768-cc55-4761-9ec9-b3c1b138e4bf\") " pod="kserve/odh-model-controller-75d9cdbddf-2r6rc"
Jul 29 10:37:36.619520 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:36.619488    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8hps\" (UniqueName: \"kubernetes.io/projected/aa40a768-cc55-4761-9ec9-b3c1b138e4bf-kube-api-access-g8hps\") pod \"odh-model-controller-75d9cdbddf-2r6rc\" (UID: \"aa40a768-cc55-4761-9ec9-b3c1b138e4bf\") " pod="kserve/odh-model-controller-75d9cdbddf-2r6rc"
Jul 29 10:37:36.738889 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:36.738804    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-75d9cdbddf-2r6rc"
Jul 29 10:37:36.875776 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:36.875611    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-2r6rc"]
Jul 29 10:37:36.878566 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:37:36.878539    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa40a768_cc55_4761_9ec9_b3c1b138e4bf.slice/crio-33b6b2ffec4c77c81168dff08ffe951dc05756381e3d9671e6aafac9f602f614 WatchSource:0}: Error finding container 33b6b2ffec4c77c81168dff08ffe951dc05756381e3d9671e6aafac9f602f614: Status 404 returned error can't find the container with id 33b6b2ffec4c77c81168dff08ffe951dc05756381e3d9671e6aafac9f602f614
Jul 29 10:37:37.538124 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:37.538083    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-75d9cdbddf-2r6rc" event={"ID":"aa40a768-cc55-4761-9ec9-b3c1b138e4bf","Type":"ContainerStarted","Data":"33b6b2ffec4c77c81168dff08ffe951dc05756381e3d9671e6aafac9f602f614"}
Jul 29 10:37:40.552492 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:40.552456    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-75d9cdbddf-2r6rc" event={"ID":"aa40a768-cc55-4761-9ec9-b3c1b138e4bf","Type":"ContainerStarted","Data":"4bc90edbc671225343e581fbe6e4dd42373cb748a0031ad9dae317059c411c1e"}
Jul 29 10:37:40.552890 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:40.552601    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-75d9cdbddf-2r6rc"
Jul 29 10:37:40.572431 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:40.572351    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-75d9cdbddf-2r6rc" podStartSLOduration=1.829034814 podStartE2EDuration="4.572335209s" totalImagesPullingTime="2.743300395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:37:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:37:40.571878326 +0000 UTC m=+510.517117195" watchObservedRunningTime="2026-07-29 10:37:40.572335209 +0000 UTC m=+510.517574055"
Jul 29 10:37:51.558743 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:37:51.558693    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-75d9cdbddf-2r6rc"
Jul 29 10:39:10.978041 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:10.977993    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46"]
Jul 29 10:39:10.981094 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:10.981076    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46"
Jul 29 10:39:10.984021 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:10.984001    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\""
Jul 29 10:39:10.984142 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:10.984118    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-fp5lb\""
Jul 29 10:39:10.989445 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:10.989423    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46"]
Jul 29 10:39:10.998548 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:10.998522    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpg7p\" (UniqueName: \"kubernetes.io/projected/209d935f-9bf3-4d50-a4d2-1e095e10d528-kube-api-access-lpg7p\") pod \"seaweedfs-tls-custom-6644bf5d6c-ptq46\" (UID: \"209d935f-9bf3-4d50-a4d2-1e095e10d528\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46"
Jul 29 10:39:10.998642 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:10.998594    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/209d935f-9bf3-4d50-a4d2-1e095e10d528-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-ptq46\" (UID: \"209d935f-9bf3-4d50-a4d2-1e095e10d528\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46"
Jul 29 10:39:11.099923 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:11.099886    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpg7p\" (UniqueName: \"kubernetes.io/projected/209d935f-9bf3-4d50-a4d2-1e095e10d528-kube-api-access-lpg7p\") pod \"seaweedfs-tls-custom-6644bf5d6c-ptq46\" (UID: \"209d935f-9bf3-4d50-a4d2-1e095e10d528\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46"
Jul 29 10:39:11.099923 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:11.099926    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/209d935f-9bf3-4d50-a4d2-1e095e10d528-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-ptq46\" (UID: \"209d935f-9bf3-4d50-a4d2-1e095e10d528\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46"
Jul 29 10:39:11.100305 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:11.100286    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/209d935f-9bf3-4d50-a4d2-1e095e10d528-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-ptq46\" (UID: \"209d935f-9bf3-4d50-a4d2-1e095e10d528\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46"
Jul 29 10:39:11.108544 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:11.108512    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpg7p\" (UniqueName: \"kubernetes.io/projected/209d935f-9bf3-4d50-a4d2-1e095e10d528-kube-api-access-lpg7p\") pod \"seaweedfs-tls-custom-6644bf5d6c-ptq46\" (UID: \"209d935f-9bf3-4d50-a4d2-1e095e10d528\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46"
Jul 29 10:39:11.291147 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:11.291038    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46"
Jul 29 10:39:11.423060 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:11.423033    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46"]
Jul 29 10:39:11.425120 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:39:11.425084    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod209d935f_9bf3_4d50_a4d2_1e095e10d528.slice/crio-6c9d1e78b0c5a815016d1c8a873db7c037be5008abff84833184b9d5afd16021 WatchSource:0}: Error finding container 6c9d1e78b0c5a815016d1c8a873db7c037be5008abff84833184b9d5afd16021: Status 404 returned error can't find the container with id 6c9d1e78b0c5a815016d1c8a873db7c037be5008abff84833184b9d5afd16021
Jul 29 10:39:11.921091 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:11.921052    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46" event={"ID":"209d935f-9bf3-4d50-a4d2-1e095e10d528","Type":"ContainerStarted","Data":"6c9d1e78b0c5a815016d1c8a873db7c037be5008abff84833184b9d5afd16021"}
Jul 29 10:39:14.935734 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:14.935684    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46" event={"ID":"209d935f-9bf3-4d50-a4d2-1e095e10d528","Type":"ContainerStarted","Data":"73acccfd27509a8671805cdc9bd72b51cdfd8506904ef7aba57cf018647c2d5c"}
Jul 29 10:39:14.953088 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:14.953038    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46" podStartSLOduration=2.177965527 podStartE2EDuration="4.953024259s" totalImagesPullingTime="2.775058732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:39:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:39:14.952290939 +0000 UTC m=+604.897529786" watchObservedRunningTime="2026-07-29 10:39:14.953024259 +0000 UTC m=+604.898263141"
Jul 29 10:39:16.312935 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:16.312899    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46"]
Jul 29 10:39:16.943066 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:16.942998    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46" podUID="209d935f-9bf3-4d50-a4d2-1e095e10d528" containerName="seaweedfs-tls-custom" containerID="cri-o://73acccfd27509a8671805cdc9bd72b51cdfd8506904ef7aba57cf018647c2d5c" gracePeriod=30
Jul 29 10:39:44.886072 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:44.886048    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46"
Jul 29 10:39:44.961100 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:44.961069    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/209d935f-9bf3-4d50-a4d2-1e095e10d528-data\") pod \"209d935f-9bf3-4d50-a4d2-1e095e10d528\" (UID: \"209d935f-9bf3-4d50-a4d2-1e095e10d528\") "
Jul 29 10:39:44.961273 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:44.961138    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpg7p\" (UniqueName: \"kubernetes.io/projected/209d935f-9bf3-4d50-a4d2-1e095e10d528-kube-api-access-lpg7p\") pod \"209d935f-9bf3-4d50-a4d2-1e095e10d528\" (UID: \"209d935f-9bf3-4d50-a4d2-1e095e10d528\") "
Jul 29 10:39:44.962500 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:44.962469    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/209d935f-9bf3-4d50-a4d2-1e095e10d528-data" (OuterVolumeSpecName: "data") pod "209d935f-9bf3-4d50-a4d2-1e095e10d528" (UID: "209d935f-9bf3-4d50-a4d2-1e095e10d528"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 10:39:44.963149 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:44.963127    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/209d935f-9bf3-4d50-a4d2-1e095e10d528-kube-api-access-lpg7p" (OuterVolumeSpecName: "kube-api-access-lpg7p") pod "209d935f-9bf3-4d50-a4d2-1e095e10d528" (UID: "209d935f-9bf3-4d50-a4d2-1e095e10d528"). InnerVolumeSpecName "kube-api-access-lpg7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 10:39:45.058929 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:45.058833    2567 generic.go:356] "Generic (PLEG): container finished" podID="209d935f-9bf3-4d50-a4d2-1e095e10d528" containerID="73acccfd27509a8671805cdc9bd72b51cdfd8506904ef7aba57cf018647c2d5c" exitCode=0
Jul 29 10:39:45.058929 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:45.058879    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46"
Jul 29 10:39:45.058929 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:45.058917    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46" event={"ID":"209d935f-9bf3-4d50-a4d2-1e095e10d528","Type":"ContainerDied","Data":"73acccfd27509a8671805cdc9bd72b51cdfd8506904ef7aba57cf018647c2d5c"}
Jul 29 10:39:45.059203 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:45.058963    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46" event={"ID":"209d935f-9bf3-4d50-a4d2-1e095e10d528","Type":"ContainerDied","Data":"6c9d1e78b0c5a815016d1c8a873db7c037be5008abff84833184b9d5afd16021"}
Jul 29 10:39:45.059203 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:45.058984    2567 scope.go:117] "RemoveContainer" containerID="73acccfd27509a8671805cdc9bd72b51cdfd8506904ef7aba57cf018647c2d5c"
Jul 29 10:39:45.061833 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:45.061809    2567 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/209d935f-9bf3-4d50-a4d2-1e095e10d528-data\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:39:45.061833 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:45.061835    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpg7p\" (UniqueName: \"kubernetes.io/projected/209d935f-9bf3-4d50-a4d2-1e095e10d528-kube-api-access-lpg7p\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 10:39:45.068512 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:45.068495    2567 scope.go:117] "RemoveContainer" containerID="73acccfd27509a8671805cdc9bd72b51cdfd8506904ef7aba57cf018647c2d5c"
Jul 29 10:39:45.068771 ip-10-0-138-159 kubenswrapper[2567]: E0729 10:39:45.068752    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73acccfd27509a8671805cdc9bd72b51cdfd8506904ef7aba57cf018647c2d5c\": container with ID starting with 73acccfd27509a8671805cdc9bd72b51cdfd8506904ef7aba57cf018647c2d5c not found: ID does not exist" containerID="73acccfd27509a8671805cdc9bd72b51cdfd8506904ef7aba57cf018647c2d5c"
Jul 29 10:39:45.068864 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:45.068780    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73acccfd27509a8671805cdc9bd72b51cdfd8506904ef7aba57cf018647c2d5c"} err="failed to get container status \"73acccfd27509a8671805cdc9bd72b51cdfd8506904ef7aba57cf018647c2d5c\": rpc error: code = NotFound desc = could not find container \"73acccfd27509a8671805cdc9bd72b51cdfd8506904ef7aba57cf018647c2d5c\": container with ID starting with 73acccfd27509a8671805cdc9bd72b51cdfd8506904ef7aba57cf018647c2d5c not found: ID does not exist"
Jul 29 10:39:45.081490 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:45.081466    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46"]
Jul 29 10:39:45.087656 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:45.087631    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-ptq46"]
Jul 29 10:39:46.562524 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:39:46.562490    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="209d935f-9bf3-4d50-a4d2-1e095e10d528" path="/var/lib/kubelet/pods/209d935f-9bf3-4d50-a4d2-1e095e10d528/volumes"
Jul 29 10:59:47.353933 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.353902    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"]
Jul 29 10:59:47.354397 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.354198    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="209d935f-9bf3-4d50-a4d2-1e095e10d528" containerName="seaweedfs-tls-custom"
Jul 29 10:59:47.354397 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.354208    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="209d935f-9bf3-4d50-a4d2-1e095e10d528" containerName="seaweedfs-tls-custom"
Jul 29 10:59:47.354397 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.354264    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="209d935f-9bf3-4d50-a4d2-1e095e10d528" containerName="seaweedfs-tls-custom"
Jul 29 10:59:47.362229 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.362203    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 10:59:47.365586 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.365552    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-v2-predictor-serving-cert\""
Jul 29 10:59:47.365586 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.365571    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fbsmh\""
Jul 29 10:59:47.365838 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.365571    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 29 10:59:47.367530 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.367490    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-kube-rbac-proxy-sar-config\""
Jul 29 10:59:47.367530 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.367488    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 29 10:59:47.367750 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.367517    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 29 10:59:47.367848 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.367828    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 29 10:59:47.369483 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.369462    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"]
Jul 29 10:59:47.406317 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.406285    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ghzp\" (UniqueName: \"kubernetes.io/projected/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-kube-api-access-5ghzp\") pod \"isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4\" (UID: \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 10:59:47.406317 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.406320    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4\" (UID: \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 10:59:47.406507 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.406395    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4\" (UID: \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 10:59:47.406507 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.406482    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4\" (UID: \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 10:59:47.406583 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.406514    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4\" (UID: \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 10:59:47.507527 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.507487    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4\" (UID: \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 10:59:47.507773 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.507540    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4\" (UID: \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 10:59:47.507773 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.507562    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4\" (UID: \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 10:59:47.507773 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.507593    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ghzp\" (UniqueName: \"kubernetes.io/projected/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-kube-api-access-5ghzp\") pod \"isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4\" (UID: \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 10:59:47.507773 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.507616    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4\" (UID: \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 10:59:47.508161 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.508131    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4\" (UID: \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 10:59:47.508433 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.508415    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4\" (UID: \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 10:59:47.508478 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.508431    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4\" (UID: \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 10:59:47.510038 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.510020    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4\" (UID: \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 10:59:47.515734 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.515689    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ghzp\" (UniqueName: \"kubernetes.io/projected/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-kube-api-access-5ghzp\") pod \"isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4\" (UID: \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 10:59:47.674148 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.674110    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 10:59:47.804696 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.804671    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"]
Jul 29 10:59:47.806911 ip-10-0-138-159 kubenswrapper[2567]: W0729 10:59:47.806885    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccaafdaf_f8b0_4f85_b3ca_ea7ef56be6be.slice/crio-0c01a02822f52983b210adba0819346708a9aeab4739a15be67b560d4a424562 WatchSource:0}: Error finding container 0c01a02822f52983b210adba0819346708a9aeab4739a15be67b560d4a424562: Status 404 returned error can't find the container with id 0c01a02822f52983b210adba0819346708a9aeab4739a15be67b560d4a424562
Jul 29 10:59:47.808839 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.808824    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 10:59:47.850613 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:47.850582    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" event={"ID":"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be","Type":"ContainerStarted","Data":"0c01a02822f52983b210adba0819346708a9aeab4739a15be67b560d4a424562"}
Jul 29 10:59:51.870519 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:51.870479    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" event={"ID":"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be","Type":"ContainerStarted","Data":"2f578ee98891eac26dcb4e607a064ce698161819caffaedb02636a07c5ed08a8"}
Jul 29 10:59:55.888124 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:55.888089    2567 generic.go:356] "Generic (PLEG): container finished" podID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerID="2f578ee98891eac26dcb4e607a064ce698161819caffaedb02636a07c5ed08a8" exitCode=0
Jul 29 10:59:55.888488 ip-10-0-138-159 kubenswrapper[2567]: I0729 10:59:55.888161    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" event={"ID":"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be","Type":"ContainerDied","Data":"2f578ee98891eac26dcb4e607a064ce698161819caffaedb02636a07c5ed08a8"}
Jul 29 11:00:08.955100 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:00:08.955064    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" event={"ID":"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be","Type":"ContainerStarted","Data":"ce106ea101c21e45ba6e62b6171086d1e54a65b0bafb6696c1c91784ce7117b2"}
Jul 29 11:00:11.971524 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:00:11.971480    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" event={"ID":"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be","Type":"ContainerStarted","Data":"6ae6ef1e26c64568397599760f4317bdca9a68faa3caa30c5fde5eece3c8a9ef"}
Jul 29 11:00:11.971976 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:00:11.971638    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 11:00:11.994849 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:00:11.994780    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" podStartSLOduration=2.047120988 podStartE2EDuration="24.994759209s" totalImagesPullingTime="19.013285191s" totalInitContainerRuntime="3.93435303s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:59:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 11:00:11.99283552 +0000 UTC m=+1861.938074364" watchObservedRunningTime="2026-07-29 11:00:11.994759209 +0000 UTC m=+1861.939998055"
Jul 29 11:00:12.976125 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:00:12.976096    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 11:00:12.977411 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:00:12.977388    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 29 11:00:13.980602 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:00:13.980554    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 29 11:00:18.985960 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:00:18.985929    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 11:00:18.986468 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:00:18.986438    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 29 11:00:28.986640 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:00:28.986599    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 29 11:00:38.987067 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:00:38.986988    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 29 11:00:48.986651 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:00:48.986610    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 29 11:00:58.986869 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:00:58.986830    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 29 11:01:08.986976 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:08.986936    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 29 11:01:18.987353 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:18.987306    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 29 11:01:24.561821 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:24.561793    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 11:01:27.548860 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:27.548822    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"]
Jul 29 11:01:27.549329 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:27.549124    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerName="kserve-container" containerID="cri-o://ce106ea101c21e45ba6e62b6171086d1e54a65b0bafb6696c1c91784ce7117b2" gracePeriod=30
Jul 29 11:01:27.549329 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:27.549146    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerName="kube-rbac-proxy" containerID="cri-o://6ae6ef1e26c64568397599760f4317bdca9a68faa3caa30c5fde5eece3c8a9ef" gracePeriod=30
Jul 29 11:01:28.283012 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:28.282979    2567 generic.go:356] "Generic (PLEG): container finished" podID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerID="6ae6ef1e26c64568397599760f4317bdca9a68faa3caa30c5fde5eece3c8a9ef" exitCode=2
Jul 29 11:01:28.283192 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:28.283035    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" event={"ID":"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be","Type":"ContainerDied","Data":"6ae6ef1e26c64568397599760f4317bdca9a68faa3caa30c5fde5eece3c8a9ef"}
Jul 29 11:01:28.981130 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:28.981087    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.27:8643/healthz\": dial tcp 10.134.0.27:8643: connect: connection refused"
Jul 29 11:01:32.300373 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:32.300331    2567 generic.go:356] "Generic (PLEG): container finished" podID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerID="ce106ea101c21e45ba6e62b6171086d1e54a65b0bafb6696c1c91784ce7117b2" exitCode=0
Jul 29 11:01:32.300373 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:32.300356    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" event={"ID":"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be","Type":"ContainerDied","Data":"ce106ea101c21e45ba6e62b6171086d1e54a65b0bafb6696c1c91784ce7117b2"}
Jul 29 11:01:32.394801 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:32.394767    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 11:01:32.500557 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:32.500472    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-kserve-provision-location\") pod \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\" (UID: \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\") "
Jul 29 11:01:32.500557 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:32.500516    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-kube-rbac-proxy-sar-config\") pod \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\" (UID: \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\") "
Jul 29 11:01:32.500836 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:32.500607    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-cabundle-cert\") pod \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\" (UID: \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\") "
Jul 29 11:01:32.500836 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:32.500748    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-proxy-tls\") pod \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\" (UID: \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\") "
Jul 29 11:01:32.500836 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:32.500792    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ghzp\" (UniqueName: \"kubernetes.io/projected/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-kube-api-access-5ghzp\") pod \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\" (UID: \"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be\") "
Jul 29 11:01:32.501004 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:32.500831    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" (UID: "ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 11:01:32.501004 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:32.500956    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" (UID: "ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 11:01:32.501004 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:32.500966    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" (UID: "ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 11:01:32.501108 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:32.501054    2567 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-cabundle-cert\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:01:32.501108 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:32.501070    2567 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-kserve-provision-location\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:01:32.501108 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:32.501080    2567 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:01:32.502960 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:32.502932    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-kube-api-access-5ghzp" (OuterVolumeSpecName: "kube-api-access-5ghzp") pod "ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" (UID: "ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be"). InnerVolumeSpecName "kube-api-access-5ghzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 11:01:32.503043 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:32.502959    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" (UID: "ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 11:01:32.602135 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:32.602104    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-proxy-tls\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:01:32.602135 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:32.602129    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ghzp\" (UniqueName: \"kubernetes.io/projected/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be-kube-api-access-5ghzp\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:01:33.306760 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:33.306704    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4" event={"ID":"ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be","Type":"ContainerDied","Data":"0c01a02822f52983b210adba0819346708a9aeab4739a15be67b560d4a424562"}
Jul 29 11:01:33.307227 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:33.306769    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"
Jul 29 11:01:33.307227 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:33.306810    2567 scope.go:117] "RemoveContainer" containerID="6ae6ef1e26c64568397599760f4317bdca9a68faa3caa30c5fde5eece3c8a9ef"
Jul 29 11:01:33.317470 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:33.316181    2567 scope.go:117] "RemoveContainer" containerID="ce106ea101c21e45ba6e62b6171086d1e54a65b0bafb6696c1c91784ce7117b2"
Jul 29 11:01:33.325243 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:33.325220    2567 scope.go:117] "RemoveContainer" containerID="2f578ee98891eac26dcb4e607a064ce698161819caffaedb02636a07c5ed08a8"
Jul 29 11:01:33.326678 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:33.326660    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"]
Jul 29 11:01:33.330286 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:33.330264    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-869c8cbf4f-pgdm4"]
Jul 29 11:01:34.562586 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:01:34.562550    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" path="/var/lib/kubelet/pods/ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be/volumes"
Jul 29 11:02:57.772760 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.772724    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"]
Jul 29 11:02:57.773216 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.773022    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerName="kserve-container"
Jul 29 11:02:57.773216 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.773033    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerName="kserve-container"
Jul 29 11:02:57.773216 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.773053    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerName="kube-rbac-proxy"
Jul 29 11:02:57.773216 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.773059    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerName="kube-rbac-proxy"
Jul 29 11:02:57.773216 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.773065    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerName="storage-initializer"
Jul 29 11:02:57.773216 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.773072    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerName="storage-initializer"
Jul 29 11:02:57.773216 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.773116    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerName="kube-rbac-proxy"
Jul 29 11:02:57.773216 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.773123    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccaafdaf-f8b0-4f85-b3ca-ea7ef56be6be" containerName="kserve-container"
Jul 29 11:02:57.776215 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.776193    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:02:57.779345 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.779323    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-kube-rbac-proxy-sar-config\""
Jul 29 11:02:57.779345 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.779343    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 29 11:02:57.779525 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.779366    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-predictor-serving-cert\""
Jul 29 11:02:57.779782 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.779763    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 29 11:02:57.779877 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.779862    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 29 11:02:57.780020 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.780008    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 29 11:02:57.780603 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.780588    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fbsmh\""
Jul 29 11:02:57.789215 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.789190    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"]
Jul 29 11:02:57.871455 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.871424    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ab847e51-3d50-43bb-830a-582d0fe77b4c-cabundle-cert\") pod \"isvc-canary-rollback-predictor-79b59b5966-6czsv\" (UID: \"ab847e51-3d50-43bb-830a-582d0fe77b4c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:02:57.871455 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.871460    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab847e51-3d50-43bb-830a-582d0fe77b4c-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-79b59b5966-6czsv\" (UID: \"ab847e51-3d50-43bb-830a-582d0fe77b4c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:02:57.871703 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.871485    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ab847e51-3d50-43bb-830a-582d0fe77b4c-proxy-tls\") pod \"isvc-canary-rollback-predictor-79b59b5966-6czsv\" (UID: \"ab847e51-3d50-43bb-830a-582d0fe77b4c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:02:57.871703 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.871604    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ab847e51-3d50-43bb-830a-582d0fe77b4c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-79b59b5966-6czsv\" (UID: \"ab847e51-3d50-43bb-830a-582d0fe77b4c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:02:57.871703 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.871629    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r95z\" (UniqueName: \"kubernetes.io/projected/ab847e51-3d50-43bb-830a-582d0fe77b4c-kube-api-access-5r95z\") pod \"isvc-canary-rollback-predictor-79b59b5966-6czsv\" (UID: \"ab847e51-3d50-43bb-830a-582d0fe77b4c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:02:57.972900 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.972854    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ab847e51-3d50-43bb-830a-582d0fe77b4c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-79b59b5966-6czsv\" (UID: \"ab847e51-3d50-43bb-830a-582d0fe77b4c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:02:57.972900 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.972896    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r95z\" (UniqueName: \"kubernetes.io/projected/ab847e51-3d50-43bb-830a-582d0fe77b4c-kube-api-access-5r95z\") pod \"isvc-canary-rollback-predictor-79b59b5966-6czsv\" (UID: \"ab847e51-3d50-43bb-830a-582d0fe77b4c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:02:57.973155 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.972933    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ab847e51-3d50-43bb-830a-582d0fe77b4c-cabundle-cert\") pod \"isvc-canary-rollback-predictor-79b59b5966-6czsv\" (UID: \"ab847e51-3d50-43bb-830a-582d0fe77b4c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:02:57.973155 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.972953    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab847e51-3d50-43bb-830a-582d0fe77b4c-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-79b59b5966-6czsv\" (UID: \"ab847e51-3d50-43bb-830a-582d0fe77b4c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:02:57.973155 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.972973    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ab847e51-3d50-43bb-830a-582d0fe77b4c-proxy-tls\") pod \"isvc-canary-rollback-predictor-79b59b5966-6czsv\" (UID: \"ab847e51-3d50-43bb-830a-582d0fe77b4c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:02:57.973377 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.973358    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab847e51-3d50-43bb-830a-582d0fe77b4c-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-79b59b5966-6czsv\" (UID: \"ab847e51-3d50-43bb-830a-582d0fe77b4c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:02:57.973638 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.973619    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ab847e51-3d50-43bb-830a-582d0fe77b4c-cabundle-cert\") pod \"isvc-canary-rollback-predictor-79b59b5966-6czsv\" (UID: \"ab847e51-3d50-43bb-830a-582d0fe77b4c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:02:57.973675 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.973630    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ab847e51-3d50-43bb-830a-582d0fe77b4c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-79b59b5966-6czsv\" (UID: \"ab847e51-3d50-43bb-830a-582d0fe77b4c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:02:57.975444 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.975417    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ab847e51-3d50-43bb-830a-582d0fe77b4c-proxy-tls\") pod \"isvc-canary-rollback-predictor-79b59b5966-6czsv\" (UID: \"ab847e51-3d50-43bb-830a-582d0fe77b4c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:02:57.983811 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:57.983786    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r95z\" (UniqueName: \"kubernetes.io/projected/ab847e51-3d50-43bb-830a-582d0fe77b4c-kube-api-access-5r95z\") pod \"isvc-canary-rollback-predictor-79b59b5966-6czsv\" (UID: \"ab847e51-3d50-43bb-830a-582d0fe77b4c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:02:58.087091 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:58.086988    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:02:58.226286 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:58.226261    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"]
Jul 29 11:02:58.228798 ip-10-0-138-159 kubenswrapper[2567]: W0729 11:02:58.228768    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab847e51_3d50_43bb_830a_582d0fe77b4c.slice/crio-8c5d66bf212b7cf763ff9888b9659e396f78cce079b50afee0d2cf10cb7d143c WatchSource:0}: Error finding container 8c5d66bf212b7cf763ff9888b9659e396f78cce079b50afee0d2cf10cb7d143c: Status 404 returned error can't find the container with id 8c5d66bf212b7cf763ff9888b9659e396f78cce079b50afee0d2cf10cb7d143c
Jul 29 11:02:58.650949 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:58.650912    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" event={"ID":"ab847e51-3d50-43bb-830a-582d0fe77b4c","Type":"ContainerStarted","Data":"47d8086a2d6a3d52486fdb48f47747c553aa9e9e2630cb8c34f9b19474d755eb"}
Jul 29 11:02:58.651135 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:02:58.650979    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" event={"ID":"ab847e51-3d50-43bb-830a-582d0fe77b4c","Type":"ContainerStarted","Data":"8c5d66bf212b7cf763ff9888b9659e396f78cce079b50afee0d2cf10cb7d143c"}
Jul 29 11:03:02.668373 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:03:02.668342    2567 generic.go:356] "Generic (PLEG): container finished" podID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerID="47d8086a2d6a3d52486fdb48f47747c553aa9e9e2630cb8c34f9b19474d755eb" exitCode=0
Jul 29 11:03:02.668778 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:03:02.668417    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" event={"ID":"ab847e51-3d50-43bb-830a-582d0fe77b4c","Type":"ContainerDied","Data":"47d8086a2d6a3d52486fdb48f47747c553aa9e9e2630cb8c34f9b19474d755eb"}
Jul 29 11:03:03.675729 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:03:03.675685    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" event={"ID":"ab847e51-3d50-43bb-830a-582d0fe77b4c","Type":"ContainerStarted","Data":"0fdd44d9ea2d8ae2c2cd4c456961eb34776aeae9e4a539eb200290168323aa36"}
Jul 29 11:03:03.676075 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:03:03.675769    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" event={"ID":"ab847e51-3d50-43bb-830a-582d0fe77b4c","Type":"ContainerStarted","Data":"b53bf7449b1ad06022892c26c4776dbef922ca82f41bb721ad20ba58dd4bb141"}
Jul 29 11:03:03.676075 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:03:03.676027    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:03:03.676165 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:03:03.676153    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:03:03.677507 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:03:03.677480    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 29 11:03:03.697057 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:03:03.697004    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" podStartSLOduration=2.944280607 podStartE2EDuration="6.696989196s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.752708589s" isStatefulPod=false podCreationTimestamp="2026-07-29 11:02:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 11:03:03.695077021 +0000 UTC m=+2033.640315891" watchObservedRunningTime="2026-07-29 11:03:03.696989196 +0000 UTC m=+2033.642228041"
Jul 29 11:03:04.680108 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:03:04.680070    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 29 11:03:09.684609 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:03:09.684577    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:03:09.685193 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:03:09.685166    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 29 11:03:19.685904 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:03:19.685862    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 29 11:03:29.685448 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:03:29.685406    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 29 11:03:39.685240 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:03:39.685202    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 29 11:03:49.686116 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:03:49.686074    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 29 11:03:59.685185 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:03:59.685144    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 29 11:04:09.685731 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:09.685685    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 29 11:04:19.685621 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:19.685590    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:04:27.921651 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:27.921608    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"]
Jul 29 11:04:27.922138 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:27.921928    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="kserve-container" containerID="cri-o://b53bf7449b1ad06022892c26c4776dbef922ca82f41bb721ad20ba58dd4bb141" gracePeriod=30
Jul 29 11:04:27.922138 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:27.921997    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="kube-rbac-proxy" containerID="cri-o://0fdd44d9ea2d8ae2c2cd4c456961eb34776aeae9e4a539eb200290168323aa36" gracePeriod=30
Jul 29 11:04:29.019236 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:29.019203    2567 generic.go:356] "Generic (PLEG): container finished" podID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerID="0fdd44d9ea2d8ae2c2cd4c456961eb34776aeae9e4a539eb200290168323aa36" exitCode=2
Jul 29 11:04:29.019623 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:29.019276    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" event={"ID":"ab847e51-3d50-43bb-830a-582d0fe77b4c","Type":"ContainerDied","Data":"0fdd44d9ea2d8ae2c2cd4c456961eb34776aeae9e4a539eb200290168323aa36"}
Jul 29 11:04:29.681040 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:29.680998    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 29 11:04:29.685329 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:29.685307    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 29 11:04:32.676894 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:32.676869    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:04:32.733645 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:32.733611    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab847e51-3d50-43bb-830a-582d0fe77b4c-kserve-provision-location\") pod \"ab847e51-3d50-43bb-830a-582d0fe77b4c\" (UID: \"ab847e51-3d50-43bb-830a-582d0fe77b4c\") "
Jul 29 11:04:32.733645 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:32.733646    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5r95z\" (UniqueName: \"kubernetes.io/projected/ab847e51-3d50-43bb-830a-582d0fe77b4c-kube-api-access-5r95z\") pod \"ab847e51-3d50-43bb-830a-582d0fe77b4c\" (UID: \"ab847e51-3d50-43bb-830a-582d0fe77b4c\") "
Jul 29 11:04:32.733905 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:32.733663    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ab847e51-3d50-43bb-830a-582d0fe77b4c-kube-rbac-proxy-sar-config\") pod \"ab847e51-3d50-43bb-830a-582d0fe77b4c\" (UID: \"ab847e51-3d50-43bb-830a-582d0fe77b4c\") "
Jul 29 11:04:32.733905 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:32.733684    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ab847e51-3d50-43bb-830a-582d0fe77b4c-proxy-tls\") pod \"ab847e51-3d50-43bb-830a-582d0fe77b4c\" (UID: \"ab847e51-3d50-43bb-830a-582d0fe77b4c\") "
Jul 29 11:04:32.733905 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:32.733783    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ab847e51-3d50-43bb-830a-582d0fe77b4c-cabundle-cert\") pod \"ab847e51-3d50-43bb-830a-582d0fe77b4c\" (UID: \"ab847e51-3d50-43bb-830a-582d0fe77b4c\") "
Jul 29 11:04:32.734063 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:32.734037    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab847e51-3d50-43bb-830a-582d0fe77b4c-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "ab847e51-3d50-43bb-830a-582d0fe77b4c" (UID: "ab847e51-3d50-43bb-830a-582d0fe77b4c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 11:04:32.734180 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:32.734158    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab847e51-3d50-43bb-830a-582d0fe77b4c-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "ab847e51-3d50-43bb-830a-582d0fe77b4c" (UID: "ab847e51-3d50-43bb-830a-582d0fe77b4c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 11:04:32.734316 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:32.734292    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab847e51-3d50-43bb-830a-582d0fe77b4c-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "ab847e51-3d50-43bb-830a-582d0fe77b4c" (UID: "ab847e51-3d50-43bb-830a-582d0fe77b4c"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 11:04:32.735860 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:32.735838    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab847e51-3d50-43bb-830a-582d0fe77b4c-kube-api-access-5r95z" (OuterVolumeSpecName: "kube-api-access-5r95z") pod "ab847e51-3d50-43bb-830a-582d0fe77b4c" (UID: "ab847e51-3d50-43bb-830a-582d0fe77b4c"). InnerVolumeSpecName "kube-api-access-5r95z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 11:04:32.735930 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:32.735856    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab847e51-3d50-43bb-830a-582d0fe77b4c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ab847e51-3d50-43bb-830a-582d0fe77b4c" (UID: "ab847e51-3d50-43bb-830a-582d0fe77b4c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 11:04:32.834572 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:32.834490    2567 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ab847e51-3d50-43bb-830a-582d0fe77b4c-cabundle-cert\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:04:32.834572 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:32.834519    2567 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab847e51-3d50-43bb-830a-582d0fe77b4c-kserve-provision-location\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:04:32.834572 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:32.834532    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5r95z\" (UniqueName: \"kubernetes.io/projected/ab847e51-3d50-43bb-830a-582d0fe77b4c-kube-api-access-5r95z\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:04:32.834572 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:32.834546    2567 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ab847e51-3d50-43bb-830a-582d0fe77b4c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:04:32.834572 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:32.834556    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ab847e51-3d50-43bb-830a-582d0fe77b4c-proxy-tls\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:04:33.042653 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:33.042617    2567 generic.go:356] "Generic (PLEG): container finished" podID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerID="b53bf7449b1ad06022892c26c4776dbef922ca82f41bb721ad20ba58dd4bb141" exitCode=0
Jul 29 11:04:33.042841 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:33.042685    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" event={"ID":"ab847e51-3d50-43bb-830a-582d0fe77b4c","Type":"ContainerDied","Data":"b53bf7449b1ad06022892c26c4776dbef922ca82f41bb721ad20ba58dd4bb141"}
Jul 29 11:04:33.042918 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:33.042699    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"
Jul 29 11:04:33.042918 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:33.042880    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv" event={"ID":"ab847e51-3d50-43bb-830a-582d0fe77b4c","Type":"ContainerDied","Data":"8c5d66bf212b7cf763ff9888b9659e396f78cce079b50afee0d2cf10cb7d143c"}
Jul 29 11:04:33.043026 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:33.042926    2567 scope.go:117] "RemoveContainer" containerID="0fdd44d9ea2d8ae2c2cd4c456961eb34776aeae9e4a539eb200290168323aa36"
Jul 29 11:04:33.052617 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:33.052589    2567 scope.go:117] "RemoveContainer" containerID="b53bf7449b1ad06022892c26c4776dbef922ca82f41bb721ad20ba58dd4bb141"
Jul 29 11:04:33.061194 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:33.061172    2567 scope.go:117] "RemoveContainer" containerID="47d8086a2d6a3d52486fdb48f47747c553aa9e9e2630cb8c34f9b19474d755eb"
Jul 29 11:04:33.068534 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:33.068516    2567 scope.go:117] "RemoveContainer" containerID="0fdd44d9ea2d8ae2c2cd4c456961eb34776aeae9e4a539eb200290168323aa36"
Jul 29 11:04:33.068829 ip-10-0-138-159 kubenswrapper[2567]: E0729 11:04:33.068803    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fdd44d9ea2d8ae2c2cd4c456961eb34776aeae9e4a539eb200290168323aa36\": container with ID starting with 0fdd44d9ea2d8ae2c2cd4c456961eb34776aeae9e4a539eb200290168323aa36 not found: ID does not exist" containerID="0fdd44d9ea2d8ae2c2cd4c456961eb34776aeae9e4a539eb200290168323aa36"
Jul 29 11:04:33.068903 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:33.068833    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fdd44d9ea2d8ae2c2cd4c456961eb34776aeae9e4a539eb200290168323aa36"} err="failed to get container status \"0fdd44d9ea2d8ae2c2cd4c456961eb34776aeae9e4a539eb200290168323aa36\": rpc error: code = NotFound desc = could not find container \"0fdd44d9ea2d8ae2c2cd4c456961eb34776aeae9e4a539eb200290168323aa36\": container with ID starting with 0fdd44d9ea2d8ae2c2cd4c456961eb34776aeae9e4a539eb200290168323aa36 not found: ID does not exist"
Jul 29 11:04:33.068903 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:33.068851    2567 scope.go:117] "RemoveContainer" containerID="b53bf7449b1ad06022892c26c4776dbef922ca82f41bb721ad20ba58dd4bb141"
Jul 29 11:04:33.069169 ip-10-0-138-159 kubenswrapper[2567]: E0729 11:04:33.069144    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b53bf7449b1ad06022892c26c4776dbef922ca82f41bb721ad20ba58dd4bb141\": container with ID starting with b53bf7449b1ad06022892c26c4776dbef922ca82f41bb721ad20ba58dd4bb141 not found: ID does not exist" containerID="b53bf7449b1ad06022892c26c4776dbef922ca82f41bb721ad20ba58dd4bb141"
Jul 29 11:04:33.069252 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:33.069218    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b53bf7449b1ad06022892c26c4776dbef922ca82f41bb721ad20ba58dd4bb141"} err="failed to get container status \"b53bf7449b1ad06022892c26c4776dbef922ca82f41bb721ad20ba58dd4bb141\": rpc error: code = NotFound desc = could not find container \"b53bf7449b1ad06022892c26c4776dbef922ca82f41bb721ad20ba58dd4bb141\": container with ID starting with b53bf7449b1ad06022892c26c4776dbef922ca82f41bb721ad20ba58dd4bb141 not found: ID does not exist"
Jul 29 11:04:33.069291 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:33.069255    2567 scope.go:117] "RemoveContainer" containerID="47d8086a2d6a3d52486fdb48f47747c553aa9e9e2630cb8c34f9b19474d755eb"
Jul 29 11:04:33.069666 ip-10-0-138-159 kubenswrapper[2567]: E0729 11:04:33.069587    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47d8086a2d6a3d52486fdb48f47747c553aa9e9e2630cb8c34f9b19474d755eb\": container with ID starting with 47d8086a2d6a3d52486fdb48f47747c553aa9e9e2630cb8c34f9b19474d755eb not found: ID does not exist" containerID="47d8086a2d6a3d52486fdb48f47747c553aa9e9e2630cb8c34f9b19474d755eb"
Jul 29 11:04:33.069778 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:33.069657    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47d8086a2d6a3d52486fdb48f47747c553aa9e9e2630cb8c34f9b19474d755eb"} err="failed to get container status \"47d8086a2d6a3d52486fdb48f47747c553aa9e9e2630cb8c34f9b19474d755eb\": rpc error: code = NotFound desc = could not find container \"47d8086a2d6a3d52486fdb48f47747c553aa9e9e2630cb8c34f9b19474d755eb\": container with ID starting with 47d8086a2d6a3d52486fdb48f47747c553aa9e9e2630cb8c34f9b19474d755eb not found: ID does not exist"
Jul 29 11:04:33.072589 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:33.072532    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"]
Jul 29 11:04:33.074293 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:33.074275    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-79b59b5966-6czsv"]
Jul 29 11:04:34.562794 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:04:34.562766    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" path="/var/lib/kubelet/pods/ab847e51-3d50-43bb-830a-582d0fe77b4c/volumes"
Jul 29 11:21:58.510833 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.510790    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"]
Jul 29 11:21:58.511692 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.511666    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="storage-initializer"
Jul 29 11:21:58.511692 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.511694    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="storage-initializer"
Jul 29 11:21:58.511873 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.511737    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="kube-rbac-proxy"
Jul 29 11:21:58.511873 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.511746    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="kube-rbac-proxy"
Jul 29 11:21:58.511873 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.511768    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="kserve-container"
Jul 29 11:21:58.511873 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.511778    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="kserve-container"
Jul 29 11:21:58.512035 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.511923    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="kube-rbac-proxy"
Jul 29 11:21:58.512035 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.511934    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab847e51-3d50-43bb-830a-582d0fe77b4c" containerName="kserve-container"
Jul 29 11:21:58.516081 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.516056    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:21:58.518720 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.518688    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-pmml-v2-kserve-predictor-serving-cert\""
Jul 29 11:21:58.519236 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.519217    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 29 11:21:58.519297 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.519258    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 29 11:21:58.520114 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.520102    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 29 11:21:58.520200 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.520115    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fbsmh\""
Jul 29 11:21:58.520200 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.520126    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-pmml-v2-kserve-kube-rbac-proxy-sar-config\""
Jul 29 11:21:58.520292 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.520204    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 29 11:21:58.524681 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.524661    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"]
Jul 29 11:21:58.663917 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.663879    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1c8c42f7-cc36-4b50-b785-e23c14796085-proxy-tls\") pod \"isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n\" (UID: \"1c8c42f7-cc36-4b50-b785-e23c14796085\") " pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:21:58.664093 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.663931    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1c8c42f7-cc36-4b50-b785-e23c14796085-kube-rbac-proxy-sar-config\") pod \"isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n\" (UID: \"1c8c42f7-cc36-4b50-b785-e23c14796085\") " pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:21:58.664093 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.664002    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1c8c42f7-cc36-4b50-b785-e23c14796085-kserve-provision-location\") pod \"isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n\" (UID: \"1c8c42f7-cc36-4b50-b785-e23c14796085\") " pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:21:58.664093 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.664065    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rp2p\" (UniqueName: \"kubernetes.io/projected/1c8c42f7-cc36-4b50-b785-e23c14796085-kube-api-access-9rp2p\") pod \"isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n\" (UID: \"1c8c42f7-cc36-4b50-b785-e23c14796085\") " pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:21:58.664257 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.664100    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1c8c42f7-cc36-4b50-b785-e23c14796085-cabundle-cert\") pod \"isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n\" (UID: \"1c8c42f7-cc36-4b50-b785-e23c14796085\") " pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:21:58.765433 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.765346    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1c8c42f7-cc36-4b50-b785-e23c14796085-proxy-tls\") pod \"isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n\" (UID: \"1c8c42f7-cc36-4b50-b785-e23c14796085\") " pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:21:58.765433 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.765388    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1c8c42f7-cc36-4b50-b785-e23c14796085-kube-rbac-proxy-sar-config\") pod \"isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n\" (UID: \"1c8c42f7-cc36-4b50-b785-e23c14796085\") " pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:21:58.765433 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.765419    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1c8c42f7-cc36-4b50-b785-e23c14796085-kserve-provision-location\") pod \"isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n\" (UID: \"1c8c42f7-cc36-4b50-b785-e23c14796085\") " pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:21:58.765699 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.765453    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rp2p\" (UniqueName: \"kubernetes.io/projected/1c8c42f7-cc36-4b50-b785-e23c14796085-kube-api-access-9rp2p\") pod \"isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n\" (UID: \"1c8c42f7-cc36-4b50-b785-e23c14796085\") " pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:21:58.765699 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.765483    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1c8c42f7-cc36-4b50-b785-e23c14796085-cabundle-cert\") pod \"isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n\" (UID: \"1c8c42f7-cc36-4b50-b785-e23c14796085\") " pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:21:58.765913 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.765895    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1c8c42f7-cc36-4b50-b785-e23c14796085-kserve-provision-location\") pod \"isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n\" (UID: \"1c8c42f7-cc36-4b50-b785-e23c14796085\") " pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:21:58.766184 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.766162    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1c8c42f7-cc36-4b50-b785-e23c14796085-kube-rbac-proxy-sar-config\") pod \"isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n\" (UID: \"1c8c42f7-cc36-4b50-b785-e23c14796085\") " pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:21:58.766241 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.766162    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1c8c42f7-cc36-4b50-b785-e23c14796085-cabundle-cert\") pod \"isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n\" (UID: \"1c8c42f7-cc36-4b50-b785-e23c14796085\") " pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:21:58.767705 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.767678    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1c8c42f7-cc36-4b50-b785-e23c14796085-proxy-tls\") pod \"isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n\" (UID: \"1c8c42f7-cc36-4b50-b785-e23c14796085\") " pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:21:58.773589 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.773565    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rp2p\" (UniqueName: \"kubernetes.io/projected/1c8c42f7-cc36-4b50-b785-e23c14796085-kube-api-access-9rp2p\") pod \"isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n\" (UID: \"1c8c42f7-cc36-4b50-b785-e23c14796085\") " pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:21:58.827580 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.827549    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:21:58.960942 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:58.960916    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"]
Jul 29 11:21:58.963614 ip-10-0-138-159 kubenswrapper[2567]: W0729 11:21:58.963585    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c8c42f7_cc36_4b50_b785_e23c14796085.slice/crio-c625d196d91ed56ea9eaf4aa364faf773e2942b09c0898a9d8df38f6739c3efc WatchSource:0}: Error finding container c625d196d91ed56ea9eaf4aa364faf773e2942b09c0898a9d8df38f6739c3efc: Status 404 returned error can't find the container with id c625d196d91ed56ea9eaf4aa364faf773e2942b09c0898a9d8df38f6739c3efc
Jul 29 11:21:59.223905 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:59.223867    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" event={"ID":"1c8c42f7-cc36-4b50-b785-e23c14796085","Type":"ContainerStarted","Data":"cb47cddbf0be995456d625f87c83abf19a0215f19499167923eabdee5c820777"}
Jul 29 11:21:59.224046 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:21:59.223934    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" event={"ID":"1c8c42f7-cc36-4b50-b785-e23c14796085","Type":"ContainerStarted","Data":"c625d196d91ed56ea9eaf4aa364faf773e2942b09c0898a9d8df38f6739c3efc"}
Jul 29 11:22:03.242483 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:22:03.242401    2567 generic.go:356] "Generic (PLEG): container finished" podID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerID="cb47cddbf0be995456d625f87c83abf19a0215f19499167923eabdee5c820777" exitCode=0
Jul 29 11:22:03.242483 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:22:03.242472    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" event={"ID":"1c8c42f7-cc36-4b50-b785-e23c14796085","Type":"ContainerDied","Data":"cb47cddbf0be995456d625f87c83abf19a0215f19499167923eabdee5c820777"}
Jul 29 11:22:03.243772 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:22:03.243755    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 11:22:10.281938 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:22:10.281904    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" event={"ID":"1c8c42f7-cc36-4b50-b785-e23c14796085","Type":"ContainerStarted","Data":"8c8af4cedb9658e052c5b53be637c55e3c4503c4b224807b3a89798ac316fcab"}
Jul 29 11:22:10.282244 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:22:10.281966    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" event={"ID":"1c8c42f7-cc36-4b50-b785-e23c14796085","Type":"ContainerStarted","Data":"43264c929bf251906eb21f4e2665b5d1cfa9e58002c96f69f220391fdcc94045"}
Jul 29 11:22:10.282244 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:22:10.282140    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:22:10.309111 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:22:10.307556    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" podStartSLOduration=1.5661287210000001 podStartE2EDuration="12.30752706s" totalImagesPullingTime="6.895256392s" totalInitContainerRuntime="3.846141947s" isStatefulPod=false podCreationTimestamp="2026-07-29 11:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 11:22:10.301119002 +0000 UTC m=+3180.246357873" watchObservedRunningTime="2026-07-29 11:22:10.30752706 +0000 UTC m=+3180.252765907"
Jul 29 11:22:11.286041 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:22:11.286011    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:22:11.287328 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:22:11.287300    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 29 11:22:12.289865 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:22:12.289819    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 29 11:22:17.295502 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:22:17.295469    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:22:17.296015 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:22:17.295987    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 29 11:22:27.296600 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:22:27.296557    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 29 11:22:37.296491 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:22:37.296445    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 29 11:22:47.296863 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:22:47.296818    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 29 11:22:57.296600 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:22:57.296563    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 29 11:23:07.296743 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:07.296647    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 29 11:23:17.296891 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:17.296844    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 29 11:23:27.295951 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:27.295912    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 29 11:23:37.297397 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:37.297362    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:23:39.587555 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:39.587520    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"]
Jul 29 11:23:39.588008 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:39.587822    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="kserve-container" containerID="cri-o://43264c929bf251906eb21f4e2665b5d1cfa9e58002c96f69f220391fdcc94045" gracePeriod=30
Jul 29 11:23:39.588008 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:39.587853    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="kube-rbac-proxy" containerID="cri-o://8c8af4cedb9658e052c5b53be637c55e3c4503c4b224807b3a89798ac316fcab" gracePeriod=30
Jul 29 11:23:40.649115 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:40.649081    2567 generic.go:356] "Generic (PLEG): container finished" podID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerID="8c8af4cedb9658e052c5b53be637c55e3c4503c4b224807b3a89798ac316fcab" exitCode=2
Jul 29 11:23:40.649492 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:40.649119    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" event={"ID":"1c8c42f7-cc36-4b50-b785-e23c14796085","Type":"ContainerDied","Data":"8c8af4cedb9658e052c5b53be637c55e3c4503c4b224807b3a89798ac316fcab"}
Jul 29 11:23:42.290266 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:42.290220    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.29:8643/healthz\": dial tcp 10.134.0.29:8643: connect: connection refused"
Jul 29 11:23:43.242082 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.242059    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:23:43.323645 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.323569    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1c8c42f7-cc36-4b50-b785-e23c14796085-kube-rbac-proxy-sar-config\") pod \"1c8c42f7-cc36-4b50-b785-e23c14796085\" (UID: \"1c8c42f7-cc36-4b50-b785-e23c14796085\") "
Jul 29 11:23:43.323645 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.323621    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1c8c42f7-cc36-4b50-b785-e23c14796085-proxy-tls\") pod \"1c8c42f7-cc36-4b50-b785-e23c14796085\" (UID: \"1c8c42f7-cc36-4b50-b785-e23c14796085\") "
Jul 29 11:23:43.324114 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.323754    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1c8c42f7-cc36-4b50-b785-e23c14796085-kserve-provision-location\") pod \"1c8c42f7-cc36-4b50-b785-e23c14796085\" (UID: \"1c8c42f7-cc36-4b50-b785-e23c14796085\") "
Jul 29 11:23:43.324114 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.323801    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rp2p\" (UniqueName: \"kubernetes.io/projected/1c8c42f7-cc36-4b50-b785-e23c14796085-kube-api-access-9rp2p\") pod \"1c8c42f7-cc36-4b50-b785-e23c14796085\" (UID: \"1c8c42f7-cc36-4b50-b785-e23c14796085\") "
Jul 29 11:23:43.324114 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.323827    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1c8c42f7-cc36-4b50-b785-e23c14796085-cabundle-cert\") pod \"1c8c42f7-cc36-4b50-b785-e23c14796085\" (UID: \"1c8c42f7-cc36-4b50-b785-e23c14796085\") "
Jul 29 11:23:43.324114 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.324014    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c8c42f7-cc36-4b50-b785-e23c14796085-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "1c8c42f7-cc36-4b50-b785-e23c14796085" (UID: "1c8c42f7-cc36-4b50-b785-e23c14796085"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 11:23:43.324304 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.324122    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c8c42f7-cc36-4b50-b785-e23c14796085-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "1c8c42f7-cc36-4b50-b785-e23c14796085" (UID: "1c8c42f7-cc36-4b50-b785-e23c14796085"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 11:23:43.324304 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.324211    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c8c42f7-cc36-4b50-b785-e23c14796085-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "1c8c42f7-cc36-4b50-b785-e23c14796085" (UID: "1c8c42f7-cc36-4b50-b785-e23c14796085"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 11:23:43.325689 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.325670    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c8c42f7-cc36-4b50-b785-e23c14796085-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "1c8c42f7-cc36-4b50-b785-e23c14796085" (UID: "1c8c42f7-cc36-4b50-b785-e23c14796085"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 11:23:43.325798 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.325733    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c8c42f7-cc36-4b50-b785-e23c14796085-kube-api-access-9rp2p" (OuterVolumeSpecName: "kube-api-access-9rp2p") pod "1c8c42f7-cc36-4b50-b785-e23c14796085" (UID: "1c8c42f7-cc36-4b50-b785-e23c14796085"). InnerVolumeSpecName "kube-api-access-9rp2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 11:23:43.425032 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.424990    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1c8c42f7-cc36-4b50-b785-e23c14796085-proxy-tls\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:23:43.425032 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.425026    2567 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1c8c42f7-cc36-4b50-b785-e23c14796085-kserve-provision-location\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:23:43.425032 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.425037    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rp2p\" (UniqueName: \"kubernetes.io/projected/1c8c42f7-cc36-4b50-b785-e23c14796085-kube-api-access-9rp2p\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:23:43.425262 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.425046    2567 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1c8c42f7-cc36-4b50-b785-e23c14796085-cabundle-cert\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:23:43.425262 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.425055    2567 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1c8c42f7-cc36-4b50-b785-e23c14796085-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:23:43.663122 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.663089    2567 generic.go:356] "Generic (PLEG): container finished" podID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerID="43264c929bf251906eb21f4e2665b5d1cfa9e58002c96f69f220391fdcc94045" exitCode=0
Jul 29 11:23:43.663283 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.663142    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" event={"ID":"1c8c42f7-cc36-4b50-b785-e23c14796085","Type":"ContainerDied","Data":"43264c929bf251906eb21f4e2665b5d1cfa9e58002c96f69f220391fdcc94045"}
Jul 29 11:23:43.663283 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.663150    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"
Jul 29 11:23:43.663283 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.663204    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n" event={"ID":"1c8c42f7-cc36-4b50-b785-e23c14796085","Type":"ContainerDied","Data":"c625d196d91ed56ea9eaf4aa364faf773e2942b09c0898a9d8df38f6739c3efc"}
Jul 29 11:23:43.663283 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.663261    2567 scope.go:117] "RemoveContainer" containerID="8c8af4cedb9658e052c5b53be637c55e3c4503c4b224807b3a89798ac316fcab"
Jul 29 11:23:43.675878 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.675854    2567 scope.go:117] "RemoveContainer" containerID="43264c929bf251906eb21f4e2665b5d1cfa9e58002c96f69f220391fdcc94045"
Jul 29 11:23:43.683184 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.683166    2567 scope.go:117] "RemoveContainer" containerID="cb47cddbf0be995456d625f87c83abf19a0215f19499167923eabdee5c820777"
Jul 29 11:23:43.688533 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.688507    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"]
Jul 29 11:23:43.692520 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.692498    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-pmml-v2-kserve-predictor-84cb55486c-4fb4n"]
Jul 29 11:23:43.693165 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.693143    2567 scope.go:117] "RemoveContainer" containerID="8c8af4cedb9658e052c5b53be637c55e3c4503c4b224807b3a89798ac316fcab"
Jul 29 11:23:43.693525 ip-10-0-138-159 kubenswrapper[2567]: E0729 11:23:43.693509    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c8af4cedb9658e052c5b53be637c55e3c4503c4b224807b3a89798ac316fcab\": container with ID starting with 8c8af4cedb9658e052c5b53be637c55e3c4503c4b224807b3a89798ac316fcab not found: ID does not exist" containerID="8c8af4cedb9658e052c5b53be637c55e3c4503c4b224807b3a89798ac316fcab"
Jul 29 11:23:43.693583 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.693531    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c8af4cedb9658e052c5b53be637c55e3c4503c4b224807b3a89798ac316fcab"} err="failed to get container status \"8c8af4cedb9658e052c5b53be637c55e3c4503c4b224807b3a89798ac316fcab\": rpc error: code = NotFound desc = could not find container \"8c8af4cedb9658e052c5b53be637c55e3c4503c4b224807b3a89798ac316fcab\": container with ID starting with 8c8af4cedb9658e052c5b53be637c55e3c4503c4b224807b3a89798ac316fcab not found: ID does not exist"
Jul 29 11:23:43.693583 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.693546    2567 scope.go:117] "RemoveContainer" containerID="43264c929bf251906eb21f4e2665b5d1cfa9e58002c96f69f220391fdcc94045"
Jul 29 11:23:43.693830 ip-10-0-138-159 kubenswrapper[2567]: E0729 11:23:43.693812    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43264c929bf251906eb21f4e2665b5d1cfa9e58002c96f69f220391fdcc94045\": container with ID starting with 43264c929bf251906eb21f4e2665b5d1cfa9e58002c96f69f220391fdcc94045 not found: ID does not exist" containerID="43264c929bf251906eb21f4e2665b5d1cfa9e58002c96f69f220391fdcc94045"
Jul 29 11:23:43.693889 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.693835    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43264c929bf251906eb21f4e2665b5d1cfa9e58002c96f69f220391fdcc94045"} err="failed to get container status \"43264c929bf251906eb21f4e2665b5d1cfa9e58002c96f69f220391fdcc94045\": rpc error: code = NotFound desc = could not find container \"43264c929bf251906eb21f4e2665b5d1cfa9e58002c96f69f220391fdcc94045\": container with ID starting with 43264c929bf251906eb21f4e2665b5d1cfa9e58002c96f69f220391fdcc94045 not found: ID does not exist"
Jul 29 11:23:43.693889 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.693852    2567 scope.go:117] "RemoveContainer" containerID="cb47cddbf0be995456d625f87c83abf19a0215f19499167923eabdee5c820777"
Jul 29 11:23:43.694069 ip-10-0-138-159 kubenswrapper[2567]: E0729 11:23:43.694054    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb47cddbf0be995456d625f87c83abf19a0215f19499167923eabdee5c820777\": container with ID starting with cb47cddbf0be995456d625f87c83abf19a0215f19499167923eabdee5c820777 not found: ID does not exist" containerID="cb47cddbf0be995456d625f87c83abf19a0215f19499167923eabdee5c820777"
Jul 29 11:23:43.694107 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:43.694073    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb47cddbf0be995456d625f87c83abf19a0215f19499167923eabdee5c820777"} err="failed to get container status \"cb47cddbf0be995456d625f87c83abf19a0215f19499167923eabdee5c820777\": rpc error: code = NotFound desc = could not find container \"cb47cddbf0be995456d625f87c83abf19a0215f19499167923eabdee5c820777\": container with ID starting with cb47cddbf0be995456d625f87c83abf19a0215f19499167923eabdee5c820777 not found: ID does not exist"
Jul 29 11:23:44.563174 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:23:44.563143    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" path="/var/lib/kubelet/pods/1c8c42f7-cc36-4b50-b785-e23c14796085/volumes"
Jul 29 11:42:41.496846 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.496743    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"]
Jul 29 11:42:41.497325 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.497139    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="storage-initializer"
Jul 29 11:42:41.497325 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.497155    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="storage-initializer"
Jul 29 11:42:41.497325 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.497173    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="kube-rbac-proxy"
Jul 29 11:42:41.497325 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.497179    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="kube-rbac-proxy"
Jul 29 11:42:41.497325 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.497186    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="kserve-container"
Jul 29 11:42:41.497325 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.497191    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="kserve-container"
Jul 29 11:42:41.499922 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.499885    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="kube-rbac-proxy"
Jul 29 11:42:41.500086 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.500074    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c8c42f7-cc36-4b50-b785-e23c14796085" containerName="kserve-container"
Jul 29 11:42:41.504532 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.504510    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:42:41.507528 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.507511    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fbsmh\""
Jul 29 11:42:41.507654 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.507554    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 29 11:42:41.507654 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.507512    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-tensorflow-kube-rbac-proxy-sar-config\""
Jul 29 11:42:41.507816 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.507692    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 29 11:42:41.508947 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.508906    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 29 11:42:41.508947 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.508928    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 29 11:42:41.509119 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.508961    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-tensorflow-predictor-serving-cert\""
Jul 29 11:42:41.512775 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.512755    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"]
Jul 29 11:42:41.534263 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.534239    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/92c1d2e1-fca9-4b6f-878e-a092af580def-kserve-provision-location\") pod \"isvc-tensorflow-predictor-547dfc5669-9hmkn\" (UID: \"92c1d2e1-fca9-4b6f-878e-a092af580def\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:42:41.534374 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.534290    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvtnh\" (UniqueName: \"kubernetes.io/projected/92c1d2e1-fca9-4b6f-878e-a092af580def-kube-api-access-fvtnh\") pod \"isvc-tensorflow-predictor-547dfc5669-9hmkn\" (UID: \"92c1d2e1-fca9-4b6f-878e-a092af580def\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:42:41.534374 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.534332    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/92c1d2e1-fca9-4b6f-878e-a092af580def-cabundle-cert\") pod \"isvc-tensorflow-predictor-547dfc5669-9hmkn\" (UID: \"92c1d2e1-fca9-4b6f-878e-a092af580def\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:42:41.534446 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.534376    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/92c1d2e1-fca9-4b6f-878e-a092af580def-kube-rbac-proxy-sar-config\") pod \"isvc-tensorflow-predictor-547dfc5669-9hmkn\" (UID: \"92c1d2e1-fca9-4b6f-878e-a092af580def\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:42:41.534446 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.534406    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/92c1d2e1-fca9-4b6f-878e-a092af580def-proxy-tls\") pod \"isvc-tensorflow-predictor-547dfc5669-9hmkn\" (UID: \"92c1d2e1-fca9-4b6f-878e-a092af580def\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:42:41.635166 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.635134    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/92c1d2e1-fca9-4b6f-878e-a092af580def-kube-rbac-proxy-sar-config\") pod \"isvc-tensorflow-predictor-547dfc5669-9hmkn\" (UID: \"92c1d2e1-fca9-4b6f-878e-a092af580def\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:42:41.635345 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.635173    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/92c1d2e1-fca9-4b6f-878e-a092af580def-proxy-tls\") pod \"isvc-tensorflow-predictor-547dfc5669-9hmkn\" (UID: \"92c1d2e1-fca9-4b6f-878e-a092af580def\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:42:41.635345 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.635210    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/92c1d2e1-fca9-4b6f-878e-a092af580def-kserve-provision-location\") pod \"isvc-tensorflow-predictor-547dfc5669-9hmkn\" (UID: \"92c1d2e1-fca9-4b6f-878e-a092af580def\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:42:41.635345 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.635270    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvtnh\" (UniqueName: \"kubernetes.io/projected/92c1d2e1-fca9-4b6f-878e-a092af580def-kube-api-access-fvtnh\") pod \"isvc-tensorflow-predictor-547dfc5669-9hmkn\" (UID: \"92c1d2e1-fca9-4b6f-878e-a092af580def\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:42:41.635345 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.635311    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/92c1d2e1-fca9-4b6f-878e-a092af580def-cabundle-cert\") pod \"isvc-tensorflow-predictor-547dfc5669-9hmkn\" (UID: \"92c1d2e1-fca9-4b6f-878e-a092af580def\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:42:41.635765 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.635741    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/92c1d2e1-fca9-4b6f-878e-a092af580def-kserve-provision-location\") pod \"isvc-tensorflow-predictor-547dfc5669-9hmkn\" (UID: \"92c1d2e1-fca9-4b6f-878e-a092af580def\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:42:41.635945 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.635927    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/92c1d2e1-fca9-4b6f-878e-a092af580def-kube-rbac-proxy-sar-config\") pod \"isvc-tensorflow-predictor-547dfc5669-9hmkn\" (UID: \"92c1d2e1-fca9-4b6f-878e-a092af580def\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:42:41.636002 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.635986    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/92c1d2e1-fca9-4b6f-878e-a092af580def-cabundle-cert\") pod \"isvc-tensorflow-predictor-547dfc5669-9hmkn\" (UID: \"92c1d2e1-fca9-4b6f-878e-a092af580def\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:42:41.637734 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.637683    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/92c1d2e1-fca9-4b6f-878e-a092af580def-proxy-tls\") pod \"isvc-tensorflow-predictor-547dfc5669-9hmkn\" (UID: \"92c1d2e1-fca9-4b6f-878e-a092af580def\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:42:41.643972 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.643950    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvtnh\" (UniqueName: \"kubernetes.io/projected/92c1d2e1-fca9-4b6f-878e-a092af580def-kube-api-access-fvtnh\") pod \"isvc-tensorflow-predictor-547dfc5669-9hmkn\" (UID: \"92c1d2e1-fca9-4b6f-878e-a092af580def\") " pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:42:41.818193 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.818099    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:42:41.950483 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:41.950457    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"]
Jul 29 11:42:41.952615 ip-10-0-138-159 kubenswrapper[2567]: W0729 11:42:41.952580    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c1d2e1_fca9_4b6f_878e_a092af580def.slice/crio-2febdb03f5943a00d9c069bdcdf23e05986fde9d7c6cf73973c346b32302252f WatchSource:0}: Error finding container 2febdb03f5943a00d9c069bdcdf23e05986fde9d7c6cf73973c346b32302252f: Status 404 returned error can't find the container with id 2febdb03f5943a00d9c069bdcdf23e05986fde9d7c6cf73973c346b32302252f
Jul 29 11:42:42.208338 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:42.208302    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn" event={"ID":"92c1d2e1-fca9-4b6f-878e-a092af580def","Type":"ContainerStarted","Data":"547370cd6d771b7fffdc131672a41f4133969956889d7cd7d458814c33132927"}
Jul 29 11:42:42.208521 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:42.208363    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn" event={"ID":"92c1d2e1-fca9-4b6f-878e-a092af580def","Type":"ContainerStarted","Data":"2febdb03f5943a00d9c069bdcdf23e05986fde9d7c6cf73973c346b32302252f"}
Jul 29 11:42:47.230784 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:47.230752    2567 generic.go:356] "Generic (PLEG): container finished" podID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerID="547370cd6d771b7fffdc131672a41f4133969956889d7cd7d458814c33132927" exitCode=0
Jul 29 11:42:47.231229 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:47.230835    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn" event={"ID":"92c1d2e1-fca9-4b6f-878e-a092af580def","Type":"ContainerDied","Data":"547370cd6d771b7fffdc131672a41f4133969956889d7cd7d458814c33132927"}
Jul 29 11:42:47.232015 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:47.231999    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 11:42:51.254161 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:51.254123    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn" event={"ID":"92c1d2e1-fca9-4b6f-878e-a092af580def","Type":"ContainerStarted","Data":"604cf324ef6d4750812da37ad009666706d8f081e1fb15c3deca99d867bdeb30"}
Jul 29 11:42:51.254530 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:51.254184    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn" event={"ID":"92c1d2e1-fca9-4b6f-878e-a092af580def","Type":"ContainerStarted","Data":"10265f2ff2b519a12c8014cc02d8660f21ab4a5e4370da42a896919a22c31bc3"}
Jul 29 11:42:51.254530 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:51.254453    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:42:51.254623 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:51.254605    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:42:51.255976 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:51.255948    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn" podUID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 29 11:42:51.275575 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:51.275531    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn" podStartSLOduration=2.235016967 podStartE2EDuration="10.275516771s" totalImagesPullingTime="3.536304435s" totalInitContainerRuntime="4.504195369s" isStatefulPod=false podCreationTimestamp="2026-07-29 11:42:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 11:42:51.273585944 +0000 UTC m=+4421.218824841" watchObservedRunningTime="2026-07-29 11:42:51.275516771 +0000 UTC m=+4421.220755617"
Jul 29 11:42:52.258599 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:52.258564    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn" podUID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 29 11:42:57.263260 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:57.263235    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:42:57.263806 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:42:57.263759    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn" podUID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 29 11:43:07.264499 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:07.264468    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:43:22.586645 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:22.586612    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"]
Jul 29 11:43:22.587121 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:22.586896    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn" podUID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerName="kserve-container" containerID="cri-o://10265f2ff2b519a12c8014cc02d8660f21ab4a5e4370da42a896919a22c31bc3" gracePeriod=30
Jul 29 11:43:22.587121 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:22.586907    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn" podUID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerName="kube-rbac-proxy" containerID="cri-o://604cf324ef6d4750812da37ad009666706d8f081e1fb15c3deca99d867bdeb30" gracePeriod=30
Jul 29 11:43:23.387414 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:23.387376    2567 generic.go:356] "Generic (PLEG): container finished" podID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerID="604cf324ef6d4750812da37ad009666706d8f081e1fb15c3deca99d867bdeb30" exitCode=2
Jul 29 11:43:23.387576 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:23.387450    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn" event={"ID":"92c1d2e1-fca9-4b6f-878e-a092af580def","Type":"ContainerDied","Data":"604cf324ef6d4750812da37ad009666706d8f081e1fb15c3deca99d867bdeb30"}
Jul 29 11:43:27.259794 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:27.259750    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn" podUID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused"
Jul 29 11:43:32.259107 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:32.259060    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn" podUID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused"
Jul 29 11:43:37.259569 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:37.259525    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn" podUID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused"
Jul 29 11:43:37.259982 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:37.259677    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:43:42.259304 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:42.259265    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn" podUID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused"
Jul 29 11:43:47.259006 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:47.258963    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn" podUID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused"
Jul 29 11:43:52.259097 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:52.259053    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn" podUID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused"
Jul 29 11:43:53.231470 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.231446    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:43:53.328269 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.328235    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/92c1d2e1-fca9-4b6f-878e-a092af580def-kserve-provision-location\") pod \"92c1d2e1-fca9-4b6f-878e-a092af580def\" (UID: \"92c1d2e1-fca9-4b6f-878e-a092af580def\") "
Jul 29 11:43:53.328269 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.328272    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/92c1d2e1-fca9-4b6f-878e-a092af580def-kube-rbac-proxy-sar-config\") pod \"92c1d2e1-fca9-4b6f-878e-a092af580def\" (UID: \"92c1d2e1-fca9-4b6f-878e-a092af580def\") "
Jul 29 11:43:53.328815 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.328314    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvtnh\" (UniqueName: \"kubernetes.io/projected/92c1d2e1-fca9-4b6f-878e-a092af580def-kube-api-access-fvtnh\") pod \"92c1d2e1-fca9-4b6f-878e-a092af580def\" (UID: \"92c1d2e1-fca9-4b6f-878e-a092af580def\") "
Jul 29 11:43:53.328815 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.328372    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/92c1d2e1-fca9-4b6f-878e-a092af580def-cabundle-cert\") pod \"92c1d2e1-fca9-4b6f-878e-a092af580def\" (UID: \"92c1d2e1-fca9-4b6f-878e-a092af580def\") "
Jul 29 11:43:53.328815 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.328428    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/92c1d2e1-fca9-4b6f-878e-a092af580def-proxy-tls\") pod \"92c1d2e1-fca9-4b6f-878e-a092af580def\" (UID: \"92c1d2e1-fca9-4b6f-878e-a092af580def\") "
Jul 29 11:43:53.328815 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.328745    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92c1d2e1-fca9-4b6f-878e-a092af580def-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "92c1d2e1-fca9-4b6f-878e-a092af580def" (UID: "92c1d2e1-fca9-4b6f-878e-a092af580def"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 11:43:53.328815 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.328780    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92c1d2e1-fca9-4b6f-878e-a092af580def-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "92c1d2e1-fca9-4b6f-878e-a092af580def" (UID: "92c1d2e1-fca9-4b6f-878e-a092af580def"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 11:43:53.330493 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.330468    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92c1d2e1-fca9-4b6f-878e-a092af580def-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "92c1d2e1-fca9-4b6f-878e-a092af580def" (UID: "92c1d2e1-fca9-4b6f-878e-a092af580def"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 11:43:53.330578 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.330533    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92c1d2e1-fca9-4b6f-878e-a092af580def-kube-api-access-fvtnh" (OuterVolumeSpecName: "kube-api-access-fvtnh") pod "92c1d2e1-fca9-4b6f-878e-a092af580def" (UID: "92c1d2e1-fca9-4b6f-878e-a092af580def"). InnerVolumeSpecName "kube-api-access-fvtnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 11:43:53.341688 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.341664    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92c1d2e1-fca9-4b6f-878e-a092af580def-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "92c1d2e1-fca9-4b6f-878e-a092af580def" (UID: "92c1d2e1-fca9-4b6f-878e-a092af580def"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 11:43:53.429973 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.429924    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/92c1d2e1-fca9-4b6f-878e-a092af580def-proxy-tls\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:43:53.429973 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.429971    2567 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/92c1d2e1-fca9-4b6f-878e-a092af580def-kserve-provision-location\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:43:53.429973 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.429985    2567 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/92c1d2e1-fca9-4b6f-878e-a092af580def-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:43:53.430213 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.429999    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvtnh\" (UniqueName: \"kubernetes.io/projected/92c1d2e1-fca9-4b6f-878e-a092af580def-kube-api-access-fvtnh\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:43:53.430213 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.430011    2567 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/92c1d2e1-fca9-4b6f-878e-a092af580def-cabundle-cert\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:43:53.509766 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.509699    2567 generic.go:356] "Generic (PLEG): container finished" podID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerID="10265f2ff2b519a12c8014cc02d8660f21ab4a5e4370da42a896919a22c31bc3" exitCode=137
Jul 29 11:43:53.509936 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.509782    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"
Jul 29 11:43:53.509936 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.509784    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn" event={"ID":"92c1d2e1-fca9-4b6f-878e-a092af580def","Type":"ContainerDied","Data":"10265f2ff2b519a12c8014cc02d8660f21ab4a5e4370da42a896919a22c31bc3"}
Jul 29 11:43:53.509936 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.509841    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn" event={"ID":"92c1d2e1-fca9-4b6f-878e-a092af580def","Type":"ContainerDied","Data":"2febdb03f5943a00d9c069bdcdf23e05986fde9d7c6cf73973c346b32302252f"}
Jul 29 11:43:53.509936 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.509870    2567 scope.go:117] "RemoveContainer" containerID="604cf324ef6d4750812da37ad009666706d8f081e1fb15c3deca99d867bdeb30"
Jul 29 11:43:53.518113 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.518098    2567 scope.go:117] "RemoveContainer" containerID="10265f2ff2b519a12c8014cc02d8660f21ab4a5e4370da42a896919a22c31bc3"
Jul 29 11:43:53.525156 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.525138    2567 scope.go:117] "RemoveContainer" containerID="547370cd6d771b7fffdc131672a41f4133969956889d7cd7d458814c33132927"
Jul 29 11:43:53.532602 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.532578    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"]
Jul 29 11:43:53.533679 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.533657    2567 scope.go:117] "RemoveContainer" containerID="604cf324ef6d4750812da37ad009666706d8f081e1fb15c3deca99d867bdeb30"
Jul 29 11:43:53.533968 ip-10-0-138-159 kubenswrapper[2567]: E0729 11:43:53.533949    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"604cf324ef6d4750812da37ad009666706d8f081e1fb15c3deca99d867bdeb30\": container with ID starting with 604cf324ef6d4750812da37ad009666706d8f081e1fb15c3deca99d867bdeb30 not found: ID does not exist" containerID="604cf324ef6d4750812da37ad009666706d8f081e1fb15c3deca99d867bdeb30"
Jul 29 11:43:53.534022 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.533978    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"604cf324ef6d4750812da37ad009666706d8f081e1fb15c3deca99d867bdeb30"} err="failed to get container status \"604cf324ef6d4750812da37ad009666706d8f081e1fb15c3deca99d867bdeb30\": rpc error: code = NotFound desc = could not find container \"604cf324ef6d4750812da37ad009666706d8f081e1fb15c3deca99d867bdeb30\": container with ID starting with 604cf324ef6d4750812da37ad009666706d8f081e1fb15c3deca99d867bdeb30 not found: ID does not exist"
Jul 29 11:43:53.534022 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.533997    2567 scope.go:117] "RemoveContainer" containerID="10265f2ff2b519a12c8014cc02d8660f21ab4a5e4370da42a896919a22c31bc3"
Jul 29 11:43:53.534216 ip-10-0-138-159 kubenswrapper[2567]: E0729 11:43:53.534202    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10265f2ff2b519a12c8014cc02d8660f21ab4a5e4370da42a896919a22c31bc3\": container with ID starting with 10265f2ff2b519a12c8014cc02d8660f21ab4a5e4370da42a896919a22c31bc3 not found: ID does not exist" containerID="10265f2ff2b519a12c8014cc02d8660f21ab4a5e4370da42a896919a22c31bc3"
Jul 29 11:43:53.534260 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.534221    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10265f2ff2b519a12c8014cc02d8660f21ab4a5e4370da42a896919a22c31bc3"} err="failed to get container status \"10265f2ff2b519a12c8014cc02d8660f21ab4a5e4370da42a896919a22c31bc3\": rpc error: code = NotFound desc = could not find container \"10265f2ff2b519a12c8014cc02d8660f21ab4a5e4370da42a896919a22c31bc3\": container with ID starting with 10265f2ff2b519a12c8014cc02d8660f21ab4a5e4370da42a896919a22c31bc3 not found: ID does not exist"
Jul 29 11:43:53.534260 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.534234    2567 scope.go:117] "RemoveContainer" containerID="547370cd6d771b7fffdc131672a41f4133969956889d7cd7d458814c33132927"
Jul 29 11:43:53.534436 ip-10-0-138-159 kubenswrapper[2567]: E0729 11:43:53.534420    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"547370cd6d771b7fffdc131672a41f4133969956889d7cd7d458814c33132927\": container with ID starting with 547370cd6d771b7fffdc131672a41f4133969956889d7cd7d458814c33132927 not found: ID does not exist" containerID="547370cd6d771b7fffdc131672a41f4133969956889d7cd7d458814c33132927"
Jul 29 11:43:53.534475 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.534440    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"547370cd6d771b7fffdc131672a41f4133969956889d7cd7d458814c33132927"} err="failed to get container status \"547370cd6d771b7fffdc131672a41f4133969956889d7cd7d458814c33132927\": rpc error: code = NotFound desc = could not find container \"547370cd6d771b7fffdc131672a41f4133969956889d7cd7d458814c33132927\": container with ID starting with 547370cd6d771b7fffdc131672a41f4133969956889d7cd7d458814c33132927 not found: ID does not exist"
Jul 29 11:43:53.534954 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:53.534935    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-tensorflow-predictor-547dfc5669-9hmkn"]
Jul 29 11:43:54.561588 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:43:54.561556    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92c1d2e1-fca9-4b6f-878e-a092af580def" path="/var/lib/kubelet/pods/92c1d2e1-fca9-4b6f-878e-a092af580def/volumes"
Jul 29 11:44:12.701079 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.701049    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"]
Jul 29 11:44:12.701468 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.701333    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerName="kube-rbac-proxy"
Jul 29 11:44:12.701468 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.701344    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerName="kube-rbac-proxy"
Jul 29 11:44:12.701468 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.701368    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerName="kserve-container"
Jul 29 11:44:12.701468 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.701377    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerName="kserve-container"
Jul 29 11:44:12.701468 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.701388    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerName="storage-initializer"
Jul 29 11:44:12.701468 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.701397    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerName="storage-initializer"
Jul 29 11:44:12.701468 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.701450    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerName="kserve-container"
Jul 29 11:44:12.701468 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.701458    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="92c1d2e1-fca9-4b6f-878e-a092af580def" containerName="kube-rbac-proxy"
Jul 29 11:44:12.705742 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.705708    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:44:12.708521 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.708496    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 29 11:44:12.708633 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.708552    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-triton-predictor-serving-cert\""
Jul 29 11:44:12.708633 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.708565    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 29 11:44:12.708633 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.708575    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fbsmh\""
Jul 29 11:44:12.708633 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.708585    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 29 11:44:12.709823 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.709804    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-triton-kube-rbac-proxy-sar-config\""
Jul 29 11:44:12.709938 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.709868    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 29 11:44:12.717701 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.717679    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"]
Jul 29 11:44:12.792286 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.792252    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7350f996-19d8-4816-a30b-67c9a676bb3b-kserve-provision-location\") pod \"isvc-triton-predictor-5d7db58676-qkwmc\" (UID: \"7350f996-19d8-4816-a30b-67c9a676bb3b\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:44:12.792286 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.792287    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7350f996-19d8-4816-a30b-67c9a676bb3b-kube-rbac-proxy-sar-config\") pod \"isvc-triton-predictor-5d7db58676-qkwmc\" (UID: \"7350f996-19d8-4816-a30b-67c9a676bb3b\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:44:12.792478 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.792308    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7350f996-19d8-4816-a30b-67c9a676bb3b-proxy-tls\") pod \"isvc-triton-predictor-5d7db58676-qkwmc\" (UID: \"7350f996-19d8-4816-a30b-67c9a676bb3b\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:44:12.792478 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.792326    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7350f996-19d8-4816-a30b-67c9a676bb3b-cabundle-cert\") pod \"isvc-triton-predictor-5d7db58676-qkwmc\" (UID: \"7350f996-19d8-4816-a30b-67c9a676bb3b\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:44:12.792478 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.792418    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qgz7\" (UniqueName: \"kubernetes.io/projected/7350f996-19d8-4816-a30b-67c9a676bb3b-kube-api-access-8qgz7\") pod \"isvc-triton-predictor-5d7db58676-qkwmc\" (UID: \"7350f996-19d8-4816-a30b-67c9a676bb3b\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:44:12.892914 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.892883    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qgz7\" (UniqueName: \"kubernetes.io/projected/7350f996-19d8-4816-a30b-67c9a676bb3b-kube-api-access-8qgz7\") pod \"isvc-triton-predictor-5d7db58676-qkwmc\" (UID: \"7350f996-19d8-4816-a30b-67c9a676bb3b\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:44:12.893091 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.892941    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7350f996-19d8-4816-a30b-67c9a676bb3b-kserve-provision-location\") pod \"isvc-triton-predictor-5d7db58676-qkwmc\" (UID: \"7350f996-19d8-4816-a30b-67c9a676bb3b\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:44:12.893091 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.893025    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7350f996-19d8-4816-a30b-67c9a676bb3b-kube-rbac-proxy-sar-config\") pod \"isvc-triton-predictor-5d7db58676-qkwmc\" (UID: \"7350f996-19d8-4816-a30b-67c9a676bb3b\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:44:12.893091 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.893071    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7350f996-19d8-4816-a30b-67c9a676bb3b-proxy-tls\") pod \"isvc-triton-predictor-5d7db58676-qkwmc\" (UID: \"7350f996-19d8-4816-a30b-67c9a676bb3b\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:44:12.893257 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.893104    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7350f996-19d8-4816-a30b-67c9a676bb3b-cabundle-cert\") pod \"isvc-triton-predictor-5d7db58676-qkwmc\" (UID: \"7350f996-19d8-4816-a30b-67c9a676bb3b\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:44:12.893331 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.893310    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7350f996-19d8-4816-a30b-67c9a676bb3b-kserve-provision-location\") pod \"isvc-triton-predictor-5d7db58676-qkwmc\" (UID: \"7350f996-19d8-4816-a30b-67c9a676bb3b\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:44:12.893757 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.893705    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7350f996-19d8-4816-a30b-67c9a676bb3b-cabundle-cert\") pod \"isvc-triton-predictor-5d7db58676-qkwmc\" (UID: \"7350f996-19d8-4816-a30b-67c9a676bb3b\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:44:12.893852 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.893784    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7350f996-19d8-4816-a30b-67c9a676bb3b-kube-rbac-proxy-sar-config\") pod \"isvc-triton-predictor-5d7db58676-qkwmc\" (UID: \"7350f996-19d8-4816-a30b-67c9a676bb3b\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:44:12.895449 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.895430    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7350f996-19d8-4816-a30b-67c9a676bb3b-proxy-tls\") pod \"isvc-triton-predictor-5d7db58676-qkwmc\" (UID: \"7350f996-19d8-4816-a30b-67c9a676bb3b\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:44:12.903114 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:12.903094    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qgz7\" (UniqueName: \"kubernetes.io/projected/7350f996-19d8-4816-a30b-67c9a676bb3b-kube-api-access-8qgz7\") pod \"isvc-triton-predictor-5d7db58676-qkwmc\" (UID: \"7350f996-19d8-4816-a30b-67c9a676bb3b\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:44:13.016819 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:13.016708    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:44:13.146843 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:13.146820    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"]
Jul 29 11:44:13.148876 ip-10-0-138-159 kubenswrapper[2567]: W0729 11:44:13.148851    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7350f996_19d8_4816_a30b_67c9a676bb3b.slice/crio-36325941e68605962c7e6bee6112418e02c9ad080443a032f63896c589e9f0d7 WatchSource:0}: Error finding container 36325941e68605962c7e6bee6112418e02c9ad080443a032f63896c589e9f0d7: Status 404 returned error can't find the container with id 36325941e68605962c7e6bee6112418e02c9ad080443a032f63896c589e9f0d7
Jul 29 11:44:13.593967 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:13.593933    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc" event={"ID":"7350f996-19d8-4816-a30b-67c9a676bb3b","Type":"ContainerStarted","Data":"47cf770be4e5ae2913f0e0046c94f135c171ed5e657a42262ab8fa4375f6f482"}
Jul 29 11:44:13.594146 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:13.593991    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc" event={"ID":"7350f996-19d8-4816-a30b-67c9a676bb3b","Type":"ContainerStarted","Data":"36325941e68605962c7e6bee6112418e02c9ad080443a032f63896c589e9f0d7"}
Jul 29 11:44:17.610611 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:17.610577    2567 generic.go:356] "Generic (PLEG): container finished" podID="7350f996-19d8-4816-a30b-67c9a676bb3b" containerID="47cf770be4e5ae2913f0e0046c94f135c171ed5e657a42262ab8fa4375f6f482" exitCode=0
Jul 29 11:44:17.610993 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:44:17.610653    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc" event={"ID":"7350f996-19d8-4816-a30b-67c9a676bb3b","Type":"ContainerDied","Data":"47cf770be4e5ae2913f0e0046c94f135c171ed5e657a42262ab8fa4375f6f482"}
Jul 29 11:46:13.184614 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:13.184579    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc" event={"ID":"7350f996-19d8-4816-a30b-67c9a676bb3b","Type":"ContainerStarted","Data":"98c3b1374413072929053553c52b3b2457d5b6dc2046da46cc9944ec93fdf044"}
Jul 29 11:46:13.185047 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:13.184644    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc" event={"ID":"7350f996-19d8-4816-a30b-67c9a676bb3b","Type":"ContainerStarted","Data":"aafbe18e9d46cfe268dbccc4caf909c63cb2edbdfb61b87e70108c7111f9e95a"}
Jul 29 11:46:13.185047 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:13.184670    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:46:13.185047 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:13.184736    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:46:13.186309 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:13.186285    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc" podUID="7350f996-19d8-4816-a30b-67c9a676bb3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 29 11:46:13.212816 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:13.212761    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc" podStartSLOduration=2.81431847 podStartE2EDuration="2m1.212743385s" totalImagesPullingTime="1m54.633148888s" totalInitContainerRuntime="3.765276027s" isStatefulPod=false podCreationTimestamp="2026-07-29 11:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 11:46:13.211506426 +0000 UTC m=+4623.156745301" watchObservedRunningTime="2026-07-29 11:46:13.212743385 +0000 UTC m=+4623.157982229"
Jul 29 11:46:14.188647 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:14.188605    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc" podUID="7350f996-19d8-4816-a30b-67c9a676bb3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 29 11:46:19.193603 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:19.193571    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:46:19.194543 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:19.194522    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:46:24.190434 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:24.190401    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"]
Jul 29 11:46:24.190922 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:24.190737    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc" podUID="7350f996-19d8-4816-a30b-67c9a676bb3b" containerName="kserve-container" containerID="cri-o://aafbe18e9d46cfe268dbccc4caf909c63cb2edbdfb61b87e70108c7111f9e95a" gracePeriod=30
Jul 29 11:46:24.190922 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:24.190807    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc" podUID="7350f996-19d8-4816-a30b-67c9a676bb3b" containerName="kube-rbac-proxy" containerID="cri-o://98c3b1374413072929053553c52b3b2457d5b6dc2046da46cc9944ec93fdf044" gracePeriod=30
Jul 29 11:46:25.240173 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:25.240138    2567 generic.go:356] "Generic (PLEG): container finished" podID="7350f996-19d8-4816-a30b-67c9a676bb3b" containerID="98c3b1374413072929053553c52b3b2457d5b6dc2046da46cc9944ec93fdf044" exitCode=2
Jul 29 11:46:25.240634 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:25.240190    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc" event={"ID":"7350f996-19d8-4816-a30b-67c9a676bb3b","Type":"ContainerDied","Data":"98c3b1374413072929053553c52b3b2457d5b6dc2046da46cc9944ec93fdf044"}
Jul 29 11:46:27.144113 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.144090    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:46:27.249607 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.249531    2567 generic.go:356] "Generic (PLEG): container finished" podID="7350f996-19d8-4816-a30b-67c9a676bb3b" containerID="aafbe18e9d46cfe268dbccc4caf909c63cb2edbdfb61b87e70108c7111f9e95a" exitCode=0
Jul 29 11:46:27.249607 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.249574    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc" event={"ID":"7350f996-19d8-4816-a30b-67c9a676bb3b","Type":"ContainerDied","Data":"aafbe18e9d46cfe268dbccc4caf909c63cb2edbdfb61b87e70108c7111f9e95a"}
Jul 29 11:46:27.249607 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.249586    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"
Jul 29 11:46:27.249860 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.249623    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc" event={"ID":"7350f996-19d8-4816-a30b-67c9a676bb3b","Type":"ContainerDied","Data":"36325941e68605962c7e6bee6112418e02c9ad080443a032f63896c589e9f0d7"}
Jul 29 11:46:27.249860 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.249652    2567 scope.go:117] "RemoveContainer" containerID="98c3b1374413072929053553c52b3b2457d5b6dc2046da46cc9944ec93fdf044"
Jul 29 11:46:27.257268 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.257253    2567 scope.go:117] "RemoveContainer" containerID="aafbe18e9d46cfe268dbccc4caf909c63cb2edbdfb61b87e70108c7111f9e95a"
Jul 29 11:46:27.264174 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.264158    2567 scope.go:117] "RemoveContainer" containerID="47cf770be4e5ae2913f0e0046c94f135c171ed5e657a42262ab8fa4375f6f482"
Jul 29 11:46:27.271063 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.271045    2567 scope.go:117] "RemoveContainer" containerID="98c3b1374413072929053553c52b3b2457d5b6dc2046da46cc9944ec93fdf044"
Jul 29 11:46:27.271350 ip-10-0-138-159 kubenswrapper[2567]: E0729 11:46:27.271323    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98c3b1374413072929053553c52b3b2457d5b6dc2046da46cc9944ec93fdf044\": container with ID starting with 98c3b1374413072929053553c52b3b2457d5b6dc2046da46cc9944ec93fdf044 not found: ID does not exist" containerID="98c3b1374413072929053553c52b3b2457d5b6dc2046da46cc9944ec93fdf044"
Jul 29 11:46:27.271413 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.271360    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98c3b1374413072929053553c52b3b2457d5b6dc2046da46cc9944ec93fdf044"} err="failed to get container status \"98c3b1374413072929053553c52b3b2457d5b6dc2046da46cc9944ec93fdf044\": rpc error: code = NotFound desc = could not find container \"98c3b1374413072929053553c52b3b2457d5b6dc2046da46cc9944ec93fdf044\": container with ID starting with 98c3b1374413072929053553c52b3b2457d5b6dc2046da46cc9944ec93fdf044 not found: ID does not exist"
Jul 29 11:46:27.271413 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.271378    2567 scope.go:117] "RemoveContainer" containerID="aafbe18e9d46cfe268dbccc4caf909c63cb2edbdfb61b87e70108c7111f9e95a"
Jul 29 11:46:27.271627 ip-10-0-138-159 kubenswrapper[2567]: E0729 11:46:27.271610    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aafbe18e9d46cfe268dbccc4caf909c63cb2edbdfb61b87e70108c7111f9e95a\": container with ID starting with aafbe18e9d46cfe268dbccc4caf909c63cb2edbdfb61b87e70108c7111f9e95a not found: ID does not exist" containerID="aafbe18e9d46cfe268dbccc4caf909c63cb2edbdfb61b87e70108c7111f9e95a"
Jul 29 11:46:27.271672 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.271633    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aafbe18e9d46cfe268dbccc4caf909c63cb2edbdfb61b87e70108c7111f9e95a"} err="failed to get container status \"aafbe18e9d46cfe268dbccc4caf909c63cb2edbdfb61b87e70108c7111f9e95a\": rpc error: code = NotFound desc = could not find container \"aafbe18e9d46cfe268dbccc4caf909c63cb2edbdfb61b87e70108c7111f9e95a\": container with ID starting with aafbe18e9d46cfe268dbccc4caf909c63cb2edbdfb61b87e70108c7111f9e95a not found: ID does not exist"
Jul 29 11:46:27.271672 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.271648    2567 scope.go:117] "RemoveContainer" containerID="47cf770be4e5ae2913f0e0046c94f135c171ed5e657a42262ab8fa4375f6f482"
Jul 29 11:46:27.271893 ip-10-0-138-159 kubenswrapper[2567]: E0729 11:46:27.271877    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47cf770be4e5ae2913f0e0046c94f135c171ed5e657a42262ab8fa4375f6f482\": container with ID starting with 47cf770be4e5ae2913f0e0046c94f135c171ed5e657a42262ab8fa4375f6f482 not found: ID does not exist" containerID="47cf770be4e5ae2913f0e0046c94f135c171ed5e657a42262ab8fa4375f6f482"
Jul 29 11:46:27.271934 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.271897    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47cf770be4e5ae2913f0e0046c94f135c171ed5e657a42262ab8fa4375f6f482"} err="failed to get container status \"47cf770be4e5ae2913f0e0046c94f135c171ed5e657a42262ab8fa4375f6f482\": rpc error: code = NotFound desc = could not find container \"47cf770be4e5ae2913f0e0046c94f135c171ed5e657a42262ab8fa4375f6f482\": container with ID starting with 47cf770be4e5ae2913f0e0046c94f135c171ed5e657a42262ab8fa4375f6f482 not found: ID does not exist"
Jul 29 11:46:27.314229 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.314198    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qgz7\" (UniqueName: \"kubernetes.io/projected/7350f996-19d8-4816-a30b-67c9a676bb3b-kube-api-access-8qgz7\") pod \"7350f996-19d8-4816-a30b-67c9a676bb3b\" (UID: \"7350f996-19d8-4816-a30b-67c9a676bb3b\") "
Jul 29 11:46:27.314360 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.314244    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7350f996-19d8-4816-a30b-67c9a676bb3b-cabundle-cert\") pod \"7350f996-19d8-4816-a30b-67c9a676bb3b\" (UID: \"7350f996-19d8-4816-a30b-67c9a676bb3b\") "
Jul 29 11:46:27.314360 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.314263    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7350f996-19d8-4816-a30b-67c9a676bb3b-proxy-tls\") pod \"7350f996-19d8-4816-a30b-67c9a676bb3b\" (UID: \"7350f996-19d8-4816-a30b-67c9a676bb3b\") "
Jul 29 11:46:27.314360 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.314280    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7350f996-19d8-4816-a30b-67c9a676bb3b-kube-rbac-proxy-sar-config\") pod \"7350f996-19d8-4816-a30b-67c9a676bb3b\" (UID: \"7350f996-19d8-4816-a30b-67c9a676bb3b\") "
Jul 29 11:46:27.314360 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.314329    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7350f996-19d8-4816-a30b-67c9a676bb3b-kserve-provision-location\") pod \"7350f996-19d8-4816-a30b-67c9a676bb3b\" (UID: \"7350f996-19d8-4816-a30b-67c9a676bb3b\") "
Jul 29 11:46:27.314687 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.314660    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7350f996-19d8-4816-a30b-67c9a676bb3b-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "7350f996-19d8-4816-a30b-67c9a676bb3b" (UID: "7350f996-19d8-4816-a30b-67c9a676bb3b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 11:46:27.314781 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.314684    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7350f996-19d8-4816-a30b-67c9a676bb3b-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "7350f996-19d8-4816-a30b-67c9a676bb3b" (UID: "7350f996-19d8-4816-a30b-67c9a676bb3b"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 11:46:27.314835 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.314813    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7350f996-19d8-4816-a30b-67c9a676bb3b-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "7350f996-19d8-4816-a30b-67c9a676bb3b" (UID: "7350f996-19d8-4816-a30b-67c9a676bb3b"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 11:46:27.316370 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.316345    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7350f996-19d8-4816-a30b-67c9a676bb3b-kube-api-access-8qgz7" (OuterVolumeSpecName: "kube-api-access-8qgz7") pod "7350f996-19d8-4816-a30b-67c9a676bb3b" (UID: "7350f996-19d8-4816-a30b-67c9a676bb3b"). InnerVolumeSpecName "kube-api-access-8qgz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 11:46:27.316452 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.316371    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7350f996-19d8-4816-a30b-67c9a676bb3b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7350f996-19d8-4816-a30b-67c9a676bb3b" (UID: "7350f996-19d8-4816-a30b-67c9a676bb3b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 11:46:27.415328 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.415296    2567 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7350f996-19d8-4816-a30b-67c9a676bb3b-kserve-provision-location\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:46:27.415328 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.415324    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qgz7\" (UniqueName: \"kubernetes.io/projected/7350f996-19d8-4816-a30b-67c9a676bb3b-kube-api-access-8qgz7\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:46:27.415328 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.415333    2567 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7350f996-19d8-4816-a30b-67c9a676bb3b-cabundle-cert\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:46:27.415562 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.415342    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7350f996-19d8-4816-a30b-67c9a676bb3b-proxy-tls\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:46:27.415562 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.415350    2567 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7350f996-19d8-4816-a30b-67c9a676bb3b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
Jul 29 11:46:27.572845 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.572815    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"]
Jul 29 11:46:27.578741 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:27.578701    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-qkwmc"]
Jul 29 11:46:28.562026 ip-10-0-138-159 kubenswrapper[2567]: I0729 11:46:28.561994    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7350f996-19d8-4816-a30b-67c9a676bb3b" path="/var/lib/kubelet/pods/7350f996-19d8-4816-a30b-67c9a676bb3b/volumes"
Jul 29 12:00:15.738849 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:15.738805    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xvrhp_b026f57e-f993-4257-8732-63e69c9aaa3c/global-pull-secret-syncer/0.log"
Jul 29 12:00:15.886311 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:15.886281    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vckm7_9301da60-53ca-42ef-82d0-675b085ca798/konnectivity-agent/0.log"
Jul 29 12:00:15.928089 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:15.928062    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-159.ec2.internal_aead170e01fe516b4b3c2976153a38af/haproxy/0.log"
Jul 29 12:00:20.255084 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:20.255037    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-vthnv_311a05aa-f71e-4eb7-8b47-fbdaa44df5cb/kube-state-metrics/0.log"
Jul 29 12:00:20.273254 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:20.273220    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-vthnv_311a05aa-f71e-4eb7-8b47-fbdaa44df5cb/kube-rbac-proxy-main/0.log"
Jul 29 12:00:20.304561 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:20.304532    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-vthnv_311a05aa-f71e-4eb7-8b47-fbdaa44df5cb/kube-rbac-proxy-self/0.log"
Jul 29 12:00:20.471102 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:20.471063    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jwgdz_3f8fe17b-b98f-4d03-9011-ea75a4681751/node-exporter/0.log"
Jul 29 12:00:20.493325 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:20.493292    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jwgdz_3f8fe17b-b98f-4d03-9011-ea75a4681751/kube-rbac-proxy/0.log"
Jul 29 12:00:20.510322 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:20.510255    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jwgdz_3f8fe17b-b98f-4d03-9011-ea75a4681751/init-textfile/0.log"
Jul 29 12:00:20.870532 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:20.870492    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-57hnh_64a56dd9-bbe8-48c3-8234-838d8c9275fa/prometheus-operator/0.log"
Jul 29 12:00:20.886638 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:20.886607    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-57hnh_64a56dd9-bbe8-48c3-8234-838d8c9275fa/kube-rbac-proxy/0.log"
Jul 29 12:00:20.943420 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:20.943380    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b7c68d45f-2nq6t_4db49e02-808b-4fa0-9efd-d46a8e7ed934/telemeter-client/0.log"
Jul 29 12:00:20.963762 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:20.963739    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b7c68d45f-2nq6t_4db49e02-808b-4fa0-9efd-d46a8e7ed934/reload/0.log"
Jul 29 12:00:20.984765 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:20.984737    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b7c68d45f-2nq6t_4db49e02-808b-4fa0-9efd-d46a8e7ed934/kube-rbac-proxy/0.log"
Jul 29 12:00:23.419893 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:23.419853    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f77d85c6d-dj2mn_a002ac10-3d81-42b9-91a3-177e29499cb0/console/0.log"
Jul 29 12:00:24.304452 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.304411    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"]
Jul 29 12:00:24.304814 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.304797    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7350f996-19d8-4816-a30b-67c9a676bb3b" containerName="kserve-container"
Jul 29 12:00:24.304908 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.304816    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7350f996-19d8-4816-a30b-67c9a676bb3b" containerName="kserve-container"
Jul 29 12:00:24.304908 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.304831    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7350f996-19d8-4816-a30b-67c9a676bb3b" containerName="kube-rbac-proxy"
Jul 29 12:00:24.304908 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.304838    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7350f996-19d8-4816-a30b-67c9a676bb3b" containerName="kube-rbac-proxy"
Jul 29 12:00:24.304908 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.304850    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7350f996-19d8-4816-a30b-67c9a676bb3b" containerName="storage-initializer"
Jul 29 12:00:24.304908 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.304859    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7350f996-19d8-4816-a30b-67c9a676bb3b" containerName="storage-initializer"
Jul 29 12:00:24.305152 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.304927    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7350f996-19d8-4816-a30b-67c9a676bb3b" containerName="kube-rbac-proxy"
Jul 29 12:00:24.305152 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.304941    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7350f996-19d8-4816-a30b-67c9a676bb3b" containerName="kserve-container"
Jul 29 12:00:24.306962 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.306940    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"
Jul 29 12:00:24.309700 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.309677    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fjdcv\"/\"kube-root-ca.crt\""
Jul 29 12:00:24.309794 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.309678    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fjdcv\"/\"openshift-service-ca.crt\""
Jul 29 12:00:24.311103 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.311086    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fjdcv\"/\"default-dockercfg-rh64t\""
Jul 29 12:00:24.315445 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.315427    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"]
Jul 29 12:00:24.348993 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.348955    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/549c172e-7c71-4998-9494-fe9fb17e577e-proc\") pod \"perf-node-gather-daemonset-77zdw\" (UID: \"549c172e-7c71-4998-9494-fe9fb17e577e\") " pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"
Jul 29 12:00:24.348993 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.348995    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/549c172e-7c71-4998-9494-fe9fb17e577e-sys\") pod \"perf-node-gather-daemonset-77zdw\" (UID: \"549c172e-7c71-4998-9494-fe9fb17e577e\") " pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"
Jul 29 12:00:24.349234 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.349021    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2ssw\" (UniqueName: \"kubernetes.io/projected/549c172e-7c71-4998-9494-fe9fb17e577e-kube-api-access-k2ssw\") pod \"perf-node-gather-daemonset-77zdw\" (UID: \"549c172e-7c71-4998-9494-fe9fb17e577e\") " pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"
Jul 29 12:00:24.349234 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.349088    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/549c172e-7c71-4998-9494-fe9fb17e577e-lib-modules\") pod \"perf-node-gather-daemonset-77zdw\" (UID: \"549c172e-7c71-4998-9494-fe9fb17e577e\") " pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"
Jul 29 12:00:24.349234 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.349127    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/549c172e-7c71-4998-9494-fe9fb17e577e-podres\") pod \"perf-node-gather-daemonset-77zdw\" (UID: \"549c172e-7c71-4998-9494-fe9fb17e577e\") " pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"
Jul 29 12:00:24.449533 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.449493    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/549c172e-7c71-4998-9494-fe9fb17e577e-proc\") pod \"perf-node-gather-daemonset-77zdw\" (UID: \"549c172e-7c71-4998-9494-fe9fb17e577e\") " pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"
Jul 29 12:00:24.449533 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.449537    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/549c172e-7c71-4998-9494-fe9fb17e577e-sys\") pod \"perf-node-gather-daemonset-77zdw\" (UID: \"549c172e-7c71-4998-9494-fe9fb17e577e\") " pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"
Jul 29 12:00:24.449972 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.449571    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2ssw\" (UniqueName: \"kubernetes.io/projected/549c172e-7c71-4998-9494-fe9fb17e577e-kube-api-access-k2ssw\") pod \"perf-node-gather-daemonset-77zdw\" (UID: \"549c172e-7c71-4998-9494-fe9fb17e577e\") " pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"
Jul 29 12:00:24.449972 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.449608    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/549c172e-7c71-4998-9494-fe9fb17e577e-lib-modules\") pod \"perf-node-gather-daemonset-77zdw\" (UID: \"549c172e-7c71-4998-9494-fe9fb17e577e\") " pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"
Jul 29 12:00:24.449972 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.449630    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/549c172e-7c71-4998-9494-fe9fb17e577e-proc\") pod \"perf-node-gather-daemonset-77zdw\" (UID: \"549c172e-7c71-4998-9494-fe9fb17e577e\") " pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"
Jul 29 12:00:24.449972 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.449639    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/549c172e-7c71-4998-9494-fe9fb17e577e-sys\") pod \"perf-node-gather-daemonset-77zdw\" (UID: \"549c172e-7c71-4998-9494-fe9fb17e577e\") " pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"
Jul 29 12:00:24.449972 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.449634    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/549c172e-7c71-4998-9494-fe9fb17e577e-podres\") pod \"perf-node-gather-daemonset-77zdw\" (UID: \"549c172e-7c71-4998-9494-fe9fb17e577e\") " pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"
Jul 29 12:00:24.449972 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.449782    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/549c172e-7c71-4998-9494-fe9fb17e577e-podres\") pod \"perf-node-gather-daemonset-77zdw\" (UID: \"549c172e-7c71-4998-9494-fe9fb17e577e\") " pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"
Jul 29 12:00:24.449972 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.449788    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/549c172e-7c71-4998-9494-fe9fb17e577e-lib-modules\") pod \"perf-node-gather-daemonset-77zdw\" (UID: \"549c172e-7c71-4998-9494-fe9fb17e577e\") " pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"
Jul 29 12:00:24.457602 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.457580    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2ssw\" (UniqueName: \"kubernetes.io/projected/549c172e-7c71-4998-9494-fe9fb17e577e-kube-api-access-k2ssw\") pod \"perf-node-gather-daemonset-77zdw\" (UID: \"549c172e-7c71-4998-9494-fe9fb17e577e\") " pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"
Jul 29 12:00:24.617758 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.617735    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"
Jul 29 12:00:24.750528 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.750488    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"]
Jul 29 12:00:24.890765 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.890658    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hgmq9_e8b9264f-d34e-4992-86ee-d9526253cd51/dns/0.log"
Jul 29 12:00:24.907562 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.907534    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hgmq9_e8b9264f-d34e-4992-86ee-d9526253cd51/kube-rbac-proxy/0.log"
Jul 29 12:00:24.925203 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:24.925174    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-np8dd_2be1c095-4863-402e-bdf9-d00c0b4fe490/dns-node-resolver/0.log"
Jul 29 12:00:25.419061 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:25.419029    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-67b5cb5b5b-nqbqn_abbead45-282a-4729-aedd-96fd38a07133/registry/0.log"
Jul 29 12:00:25.443230 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:25.443200    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2p7vc_a2c35c22-9057-4ecb-8fa3-47630fc253c6/node-ca/0.log"
Jul 29 12:00:25.620865 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:25.620829    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw" event={"ID":"549c172e-7c71-4998-9494-fe9fb17e577e","Type":"ContainerStarted","Data":"e72b05c2ea7fd6060e43f68c07633956c72e7aa5d639043adb864f92159fe562"}
Jul 29 12:00:25.621257 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:25.620886    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw" event={"ID":"549c172e-7c71-4998-9494-fe9fb17e577e","Type":"ContainerStarted","Data":"87021d89869e72be2a0c9ec11038c3a4995b73a3c66c814684deb11f492a77ea"}
Jul 29 12:00:25.621257 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:25.620929    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"
Jul 29 12:00:25.637497 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:25.637445    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw" podStartSLOduration=1.63742926 podStartE2EDuration="1.63742926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 12:00:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 12:00:25.635995814 +0000 UTC m=+5475.581234687" watchObservedRunningTime="2026-07-29 12:00:25.63742926 +0000 UTC m=+5475.582668105"
Jul 29 12:00:26.457555 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:26.457515    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nvkjd_fd4fa30e-5c9b-4216-92b2-95d72a213b77/serve-healthcheck-canary/0.log"
Jul 29 12:00:26.927578 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:26.927540    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r785v_0b0078c0-523f-4577-b635-d60eb18c9125/kube-rbac-proxy/0.log"
Jul 29 12:00:26.944134 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:26.944109    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r785v_0b0078c0-523f-4577-b635-d60eb18c9125/exporter/0.log"
Jul 29 12:00:26.966679 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:26.966654    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r785v_0b0078c0-523f-4577-b635-d60eb18c9125/extractor/0.log"
Jul 29 12:00:29.249126 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:29.249093    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-65f566c74b-xghf8_ea4e0ad4-5ec0-4b77-b6ba-aa93cae3abd6/manager/0.log"
Jul 29 12:00:29.281656 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:29.281623    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-84fc959947-nzjgw_0195d7b4-25f1-4701-b35e-a13659e80924/manager/0.log"
Jul 29 12:00:29.857640 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:29.857602    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-75d9cdbddf-2r6rc_aa40a768-cc55-4761-9ec9-b3c1b138e4bf/manager/0.log"
Jul 29 12:00:31.634782 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:31.634681    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fjdcv/perf-node-gather-daemonset-77zdw"
Jul 29 12:00:35.204157 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:35.204128    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n26w_457f5f29-b9d3-4c9e-a703-53e304308abe/kube-multus-additional-cni-plugins/0.log"
Jul 29 12:00:35.273416 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:35.273330    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n26w_457f5f29-b9d3-4c9e-a703-53e304308abe/egress-router-binary-copy/0.log"
Jul 29 12:00:35.293922 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:35.293890    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n26w_457f5f29-b9d3-4c9e-a703-53e304308abe/cni-plugins/0.log"
Jul 29 12:00:35.340306 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:35.340262    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n26w_457f5f29-b9d3-4c9e-a703-53e304308abe/bond-cni-plugin/0.log"
Jul 29 12:00:35.355282 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:35.355250    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n26w_457f5f29-b9d3-4c9e-a703-53e304308abe/routeoverride-cni/0.log"
Jul 29 12:00:35.374567 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:35.374538    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n26w_457f5f29-b9d3-4c9e-a703-53e304308abe/whereabouts-cni-bincopy/0.log"
Jul 29 12:00:35.392203 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:35.392173    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n26w_457f5f29-b9d3-4c9e-a703-53e304308abe/whereabouts-cni/0.log"
Jul 29 12:00:35.717350 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:35.717320    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bhfd5_cd6d091a-bfcf-4c05-b9ec-9b9fce47117a/kube-multus/0.log"
Jul 29 12:00:35.869322 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:35.869294    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-csxgd_4f79fb8a-c882-40cf-bffd-6685e5b15c8b/network-metrics-daemon/0.log"
Jul 29 12:00:35.884442 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:35.884414    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-csxgd_4f79fb8a-c882-40cf-bffd-6685e5b15c8b/kube-rbac-proxy/0.log"
Jul 29 12:00:36.898248 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:36.898196    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-txz46_0c1c684b-d479-45fe-86de-d8e46d15e563/ovn-controller/0.log"
Jul 29 12:00:36.911795 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:36.911736    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-txz46_0c1c684b-d479-45fe-86de-d8e46d15e563/ovn-acl-logging/0.log"
Jul 29 12:00:36.929815 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:36.929777    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-txz46_0c1c684b-d479-45fe-86de-d8e46d15e563/kube-rbac-proxy-node/0.log"
Jul 29 12:00:36.945450 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:36.945416    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-txz46_0c1c684b-d479-45fe-86de-d8e46d15e563/kube-rbac-proxy-ovn-metrics/0.log"
Jul 29 12:00:36.963832 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:36.963800    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-txz46_0c1c684b-d479-45fe-86de-d8e46d15e563/northd/0.log"
Jul 29 12:00:36.979531 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:36.979504    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-txz46_0c1c684b-d479-45fe-86de-d8e46d15e563/nbdb/0.log"
Jul 29 12:00:36.998035 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:36.998000    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-txz46_0c1c684b-d479-45fe-86de-d8e46d15e563/sbdb/0.log"
Jul 29 12:00:37.058080 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:37.058045    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-txz46_0c1c684b-d479-45fe-86de-d8e46d15e563/ovnkube-controller/0.log"
Jul 29 12:00:37.968601 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:37.968568    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-44zb2_5b84c737-c010-44f8-a233-ad9585234e65/network-check-target-container/0.log"
Jul 29 12:00:38.839593 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:38.839563    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-plh6r_b2600cf4-d12b-403e-bf31-5ce050c118ef/iptables-alerter/0.log"
Jul 29 12:00:39.414076 ip-10-0-138-159 kubenswrapper[2567]: I0729 12:00:39.414046    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-f5jjn_c7f5588f-daf4-465c-89f2-5324a87b79db/tuned/0.log"